Breaking news: batching more efficient than not batching
(I’d recommend more aggressively batching, and also looking at using speculative decoding if you don’t already)
semisol
npub122…cgrkj
2026-08-09 22:35:33 UTC
in reply to nevent1q…kphj
Author Public Key
npub12262qa4uhw7u8gdwlgmntqtv7aye8vdcmvszkqwgs0zchel6mz7s6cgrkjPublished at
2026-08-09 22:35:33 UTCEvent JSON
{
"id": "447bec426a68b98effa3ee5f9d2970aa5df5264f76634b62b8fcde0ca5768db1",
"pubkey": "52b4a076bcbbbdc3a1aefa3735816cf74993b1b8db202b01c883c58be7fad8bd",
"created_at": 1786314933,
"kind": 1,
"tags": [
[
"e",
"0000ca16ed4b943d19a8aed3372d0a44eb30171020f3220eb6b6f67f4fa00405",
"wss://relay.damus.io",
"root",
"e2ccf7cf20403f3f2a4a55b328f0de3be38558a7d5f33632fdaaefc726c1c8eb"
],
[
"p",
"e2ccf7cf20403f3f2a4a55b328f0de3be38558a7d5f33632fdaaefc726c1c8eb"
],
[
"client",
"Damus"
]
],
"content": "Breaking news: batching more efficient than not batching\n\n(I’d recommend more aggressively batching, and also looking at using speculative decoding if you don’t already)",
"sig": "46b42ba3f435e96f5cccae5355da5f523a5e130e11e6b1d040a511b96558164039e8e9b41b9345813d3d63bb257b48589c9548282c40a2700032de265b73d3ae"
}