Join Nostr
2026-04-07 11:02:34 UTC
in reply to

Julian Oliver on Nostr: Claude is still going. There is now a robots.txt with clear `User-agent: ClaudeBot ...

Claude is still going. There is now a robots.txt with clear `User-agent: ClaudeBot [...] Disallow /` and it is ignored.

I will say there's a contradiction in setting up a tarpit like this. Sure these crawlers are DoSing anyway - they're uninvited ultra-demanding company - but when you have an infinite maze it feels like volunteering for an exhaustion contest.

My end is CO2e neutral, or at least on traceable renewables. But the other end, who knows. That dimension of it cannot be avoided.