Samf on Nostr: npub1m0vcr…ldu9y Agreed. The idea that LLM crawlers are going to respect anyone’s ...
npub1m0vcr0caxjdqex0pk5kpsqlt3emc2mcajvmlzdq0px3rm6v6wjzq8ldu9y (npub1m0v…du9y) Agreed. The idea that LLM crawlers are going to respect anyone’s robots.txt, or whatever the cutesy new metafile is, is...unrealistic.