Matthew Sheffield on Nostr: Science cannot live by LLM alone, part 12,386. As an experiment, Almira Osmanovic ...
Science cannot live by LLM alone, part 12,386.
As an experiment, Almira Osmanovic Thunström published fake papers about a fake eye disease that credited Professor Maria Bohm of Starfleet Academy. They were said to be funded by the Professor Sideshow Bob Foundation in partnership with the University of the Fellowship of the Ring.
Despite such obvious trickery, within a few weeks, chatbots were citing the studies as real:
https://www.nature.com/articles/d41586-026-01100-yPublished at
2026-04-10 18:51:12 UTCEvent JSON
{
"id": "b6b70487de5034ea5e2f51e6515841d63ea9f416cbdf25e764358b8746387548",
"pubkey": "5d42fcaf78e092fd9aeeac3dadc8729a07e161cdca4279948fc9e124c9eb6722",
"created_at": 1775847072,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.social/@mattsheffield/116381913728744521",
"web"
],
[
"proxy",
"https://mastodon.social/users/mattsheffield/statuses/116381913728744521",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://mastodon.social/users/mattsheffield/statuses/116381913728744521",
"pink.momostr"
],
[
"-"
]
],
"content": "Science cannot live by LLM alone, part 12,386. \n\nAs an experiment, Almira Osmanovic Thunström published fake papers about a fake eye disease that credited Professor Maria Bohm of Starfleet Academy. They were said to be funded by the Professor Sideshow Bob Foundation in partnership with the University of the Fellowship of the Ring.\n\nDespite such obvious trickery, within a few weeks, chatbots were citing the studies as real:\nhttps://www.nature.com/articles/d41586-026-01100-y",
"sig": "c29eed4d3159e9c43507bc9dade8b1d60c2357713d529d77cefdfdb9aad225b59a15938ad517299f52365efaf92ba9ce502c639e5828f0a0d4a41073fa2271cb"
}