The innovations here are better finetuning and reasoning traces (that is, having the model output drafts and "reflecting" on them). This is indeed what has reduced the hallucination so much.
That's a bit like how you summarize it (hidden prompts), but that doesn't quite capture how rich these reasoning traces can be. See, for example https://arxiv.org/abs/2601.10825 .
Peter Bloem
npub1mj…aht0w
2026-04-08 12:27:09 UTC
in reply to nevent1q…65v5
Author Public Key
npub1mjj8dtcld0se03zd42wh9gqjg4mm04ya8azgssagnrvzlvkuq2pqmaht0wSeen on
wss://relay.momostr.pinkPublished at
2026-04-08 12:27:09 UTCEvent JSON
{
"id": "74687cb04676552670d18cf2b555e30769acd293ba3560f6f68d0c7f92e561d4",
"pubkey": "dca476af1f6be197c44daa9d72a0124577b7d49d3f448843a898d82fb2dc0282",
"created_at": 1775651229,
"kind": 1,
"tags": [
[
"proxy",
"https://sigmoid.social/@pbloem/116369078972127962",
"web"
],
[
"e",
"92f2f1ecfb6bece85e1e6df83e3ede9f9e9e2efd9e70acbe2d9dd6fc0b29a232",
"",
"root",
"dca476af1f6be197c44daa9d72a0124577b7d49d3f448843a898d82fb2dc0282"
],
[
"p",
"dca476af1f6be197c44daa9d72a0124577b7d49d3f448843a898d82fb2dc0282"
],
[
"e",
"c054a5ef748da755459a18b0b6072a885d803d110f831e7e116c242d600096aa",
"",
"reply",
"dca476af1f6be197c44daa9d72a0124577b7d49d3f448843a898d82fb2dc0282"
],
[
"p",
"722274f10b630b53567448be023b0ea9dd8713f5d6dbae94f36d194382363990"
],
[
"proxy",
"https://sigmoid.social/users/pbloem/statuses/116369078972127962",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://sigmoid.social/users/pbloem/statuses/116369078972127962",
"pink.momostr"
],
[
"-"
]
],
"content": "The innovations here are better finetuning and reasoning traces (that is, having the model output drafts and \"reflecting\" on them). This is indeed what has reduced the hallucination so much.\n\nThat's a bit like how you summarize it (hidden prompts), but that doesn't quite capture how rich these reasoning traces can be. See, for example https://arxiv.org/abs/2601.10825 .",
"sig": "06271c190f74a211bbf9bb4d14c850a538011240a428405ccefea038b4ca0a57908455cfc1a54f6f569bb356d1fec119f8ebdcc918a5bb8b78f1c1588d3738da"
}