I don't like AI slop seeping into every crevice of our online (and, increasingly, offline) lives, but I also don't think blocking LLM crawlers on my personal sites will do anything to quell the deluge or reduce the value of these LLMs to a remotely measurable degree.
Even if every single person who felt inclined to block LLM crawlers did so, I don't think LLMs would be suddenly starved for data.
It seems like a silly exercise to me.
Jay /
npub1fl…06duw
2024-07-01 15:53:22
Author Public Key
npub1flrc5hsqwqzdsfzrwqc0rzwy5a9g0swe7wmvvjcaqut6gxyset9qj06duwPublished at
2024-07-01 15:53:22Event JSON
{
"id": "03698a5799500f8d0deb74b4b993ffab350af147e7a21ab25cc20d74c5ee5fbe",
"pubkey": "4fc78a5e007004d824437030f189c4a74a87c1d9f3b6c64b1d0717a41890caca",
"created_at": 1719849202,
"kind": 1,
"tags": [
[
"proxy",
"https://social.coop/users/jsit/statuses/112712037306718781",
"activitypub"
]
],
"content": "I don't like AI slop seeping into every crevice of our online (and, increasingly, offline) lives, but I also don't think blocking LLM crawlers on my personal sites will do anything to quell the deluge or reduce the value of these LLMs to a remotely measurable degree.\n\nEven if every single person who felt inclined to block LLM crawlers did so, I don't think LLMs would be suddenly starved for data.\n\nIt seems like a silly exercise to me.",
"sig": "2fd09925e5837a61940c31df15259d530cd2e4e3d05723a3dbef0b89b539eb77dd96e737f769beb0a4172981feac6167434c926879ac375f6944ec394154697d"
}