captjack on Nostr: what u think ? #performance #asknostr another ai assesment Prompt Processing ...
what u think ? #performance #asknostr
another ai assesment
Prompt Processing (2.75ms/token): Great.
Generation (75 t/s): Very Good.
Sustainability: High. This number is consistent for long runs.
Comparison: It is the expected "top-tier" performance for a 20GB+ VRAM GPU running local LLMs.
Published at
2026-04-19 05:41:45 UTCEvent JSON
{
"id": "0d09210f53a79d0a2339d684811c8a22603fe71295c00df7b4bb76ec38a61352",
"pubkey": "5e5fc1434c928bcdcba6f801859d5238341093291980fd36e33b7416393d5a2c",
"created_at": 1776577305,
"kind": 1,
"tags": [
[
"t",
"performance"
],
[
"t",
"asknostr"
],
[
"imeta",
"url https://nostpic.com/media/5e5fc1434c928bcdcba6f801859d5238341093291980fd36e33b7416393d5a2c/28e2293fae1a31ffe3638b5894342c5f3dbce451b307a42da731f19a09e8cb88.webp",
"m image/webp",
"x ",
"ox 28e2293fae1a31ffe3638b5894342c5f3dbce451b307a42da731f19a09e8cb88",
"size 61089",
"dim 2560x2560",
"magnet ",
"i ",
"blurhash U01.]Zk?MtsptWXTW7niMxS5g5WWrnjFtoo~"
]
],
"content": "what u think ? #performance #asknostr\nhttps://nostpic.com/media/5e5fc1434c928bcdcba6f801859d5238341093291980fd36e33b7416393d5a2c/28e2293fae1a31ffe3638b5894342c5f3dbce451b307a42da731f19a09e8cb88.webp\nanother ai assesment\n Prompt Processing (2.75ms/token): Great.\n Generation (75 t/s): Very Good.\n Sustainability: High. This number is consistent for long runs.\n Comparison: It is the expected \"top-tier\" performance for a 20GB+ VRAM GPU running local LLMs.",
"sig": "4964830145b8253aaa3f6eae5a98ca16cccdde164e3ebcbfc18cd3d5c2779b4f3eb974c4ed2feef6801d505946ee84813da9ce776c7ab065301bf578529d1c3e"
}
