I was so baffled to learn how *mandatory* output verification is implemented. Any sane developer would have resorted to a compact loop along the lines of
`do { result = tool_call(…) } while (!is_valid(result));`
Zero overhead besides the wasteful repetitive tool calls in the hope of eventually getting the format right.
Instead, they have complex, expensive instructions for the LLM to do that.
https://neuromatch.social/@jonny/116326861737478342
Marcel Waldvogel
npub1p0…agzg8
2026-04-02 03:11:42 UTC
in reply to nevent1q…qjqu
Author Public Key
npub1p0hkce7e088f6d59qva0s4t5ga823ks06h4huwn90egnd79w9nts9agzg8Seen on
wss://relay.momostr.pinkPublished at
2026-04-02 03:11:42 UTCEvent JSON
{
"id": "ec9e306477bef8cd285573d1396e9f0cbaf6687035d6640a4c8347c4eedad486",
"pubkey": "0bef6c67d979ce9d3685033af85574474ea8da0fd5eb7e3a657e5136f8ae2cd7",
"created_at": 1775099502,
"kind": 1,
"tags": [
[
"e",
"b89aaa9e38f5d74780fa10a1215c2e0d7d30988e489a67d1d667e263586c4fe6",
"",
"root",
"155ff341af00ffaeb75cf67509a40440797adf02f433259b09e9a3490a6c0e1a"
],
[
"e",
"b60afce49c7bcb99a5d8639d163a282b21da2b454a023d632bb4852c371f9a38",
"",
"reply",
"ea77f5584eeec06087f47a9fe82692723f1feb889eaf3e3b885997ec2e776aec"
],
[
"p",
"fcb69b3b7fff58d0cd345a3634f49adcaabf1f0f30c9c425d505bafc5726ec1e"
],
[
"p",
"ea77f5584eeec06087f47a9fe82692723f1feb889eaf3e3b885997ec2e776aec"
],
[
"proxy",
"https://waldvogel.family/@marcel/116332921026333662",
"web"
],
[
"p",
"155ff341af00ffaeb75cf67509a40440797adf02f433259b09e9a3490a6c0e1a"
],
[
"proxy",
"https://waldvogel.family/users/marcel/statuses/116332921026333662",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://waldvogel.family/users/marcel/statuses/116332921026333662",
"pink.momostr"
],
[
"-"
]
],
"content": "I was so baffled to learn how *mandatory* output verification is implemented. Any sane developer would have resorted to a compact loop along the lines of\n\n`do { result = tool_call(…) } while (!is_valid(result));`\n\nZero overhead besides the wasteful repetitive tool calls in the hope of eventually getting the format right.\n\nInstead, they have complex, expensive instructions for the LLM to do that.\nhttps://neuromatch.social/@jonny/116326861737478342",
"sig": "324949f44a9a96ff955550f854b3dc6a126c8c489a8538c0041b0111dcfe697092c1518ea129391657decc3c9313fd2b2e3999af5de39c99c67411d14b669a58"
}