Tim Chambers on Nostr: #Admin #IndiewebSocial - Looking for the best list of AI scraper bots to block on ...
#Admin #IndiewebSocial - Looking for the best list of AI scraper bots to block on this server. Aany others?
User-agent: GPTBot
User-agent: ChatGPT-User
User-agent: Google-Extended
User-agent: PerplexityBot
User-agent: Amazonbot
User-agent: ClaudeBot
User-agent: Omgilibot
User-Agent: FacebookBot
User-Agent: Applebot
User-agent: anthropic-ai
User-agent: Bytespider
User-agent: Claude-Web
User-agent: Diffbot
User-agent: ImagesiftBot
User-agent: Omgilibot
User-agent: Omgili
User-agent: YouBot
Published at
2024-06-13 21:26:56Event JSON
{
"id": "384f8bac0656984f2b90b4ebcb8d7580d5abac5a51102285fc6130672effb80d",
"pubkey": "63064abe28b7984e0dab270e8cda259e4682299634a0c84dd5fd9bcbafb71b8f",
"created_at": 1718314016,
"kind": 1,
"tags": [
[
"t",
"admin"
],
[
"t",
"indiewebsocial"
],
[
"proxy",
"https://indieweb.social/users/tchambers/statuses/112611427413569244",
"activitypub"
]
],
"content": "#Admin #IndiewebSocial - Looking for the best list of AI scraper bots to block on this server. Aany others?\n\nUser-agent: GPTBot\nUser-agent: ChatGPT-User\nUser-agent: Google-Extended\nUser-agent: PerplexityBot\nUser-agent: Amazonbot\nUser-agent: ClaudeBot\nUser-agent: Omgilibot\nUser-Agent: FacebookBot\nUser-Agent: Applebot\nUser-agent: anthropic-ai\nUser-agent: Bytespider\nUser-agent: Claude-Web\nUser-agent: Diffbot\nUser-agent: ImagesiftBot\nUser-agent: Omgilibot\nUser-agent: Omgili\nUser-agent: YouBot",
"sig": "4dff813f85303f3f4d28c85835ce354a27c9724367cad8b0d6a5e8d5ac01bd66bb529b47b0adfa716faf6cee790f1185256f9e5ae57ab8feff9b0367b909513d"
}