SovereignBeing on Nostr: Local llms are getting more and more impressive. RTX 3090 Qwen 3.6 27B Llamacpp ...
Local llms are getting more and more impressive.
RTX 3090
Qwen 3.6 27B
Llamacpp
Hermes workspace
40 tok/s
This is easily rivalling Claude sonnet 4.5.
Published at
2026-04-25 06:54:17 UTCEvent JSON
{
"id": "9d0f962242709e65d92963107cdb537eac189384ce2ac1e94f5765e4f8d7cb79",
"pubkey": "3bcc5632a4e750953a2016f991ad8caeb18ce7537b82f25e22c0bd3b9003d8b8",
"created_at": 1777100057,
"kind": 1,
"tags": [
[
"alt",
"A short note: Local llms are getting more and more impressive.\n\n..."
],
[
"client",
"Amethyst"
]
],
"content": "Local llms are getting more and more impressive.\n\nRTX 3090\nQwen 3.6 27B\nLlamacpp\nHermes workspace\n\n40 tok/s\n\nThis is easily rivalling Claude sonnet 4.5.",
"sig": "d05b322922d64e6e71e3730dccd29cd9e95e67206b7c16d6a7025014132b1055003470afd510c0b87e104084bb2e29bbaed713738aaa964f24a8e2ae2bafcfbf"
}
