Also, I have run Qwen 3.5 9B with good success. It is tiny, and does punch way above its weight class.
May be enough for what you are trying to do, but only you can decided. For limited hardware I would go with this, though local LLMs are not going to be sufficient in most cases....
https://x.com/demiliani/status/2028721538728427774
lscmd / Los Comandantes
npub1n5…43k48
2026-03-23 02:49:50 UTC
in reply to nevent1q…kxlz
Author Public Key
npub1n50p3vxxv9nf7wzl8veg485xvc36z24gct87jenyuv2sfrwee32q843k48Seen on
wss://relay.damus.ioPublished at
2026-03-23 02:49:50 UTCEvent JSON
{
"id": "7c2fbc78d79cc6c0b78940ac69676dbafdf981c7b971727c650438552e6ccf02",
"pubkey": "9d1e18b0c661669f385f3b328a9e866623a12aa8c2cfe96664e315048dd9cc54",
"created_at": 1774234190,
"kind": 1,
"tags": [
[
"e",
"000070439b55cd95ca7aaa0bf0ee1074bdb7e3a4440eb89d068b756cf1c6ff01",
"",
"root",
"0689df5847a8d3376892da29622d7c0fdc1ef1958f4bc4471d90966aa1eca9f2"
],
[
"e",
"b77e67b257b7d97e919588831588f58686aac46e2ce3002d082cc72846ee31b5",
"",
"reply"
],
[
"p",
"0689df5847a8d3376892da29622d7c0fdc1ef1958f4bc4471d90966aa1eca9f2",
"wss://relay.ditto.pub/"
],
[
"p",
"9d1e18b0c661669f385f3b328a9e866623a12aa8c2cfe96664e315048dd9cc54"
],
[
"r",
"wss://relay.damus.io/"
],
[
"r",
"wss://relay.primal.net/"
],
[
"r",
"wss://nos.lol/"
],
[
"client",
"Primal Web"
]
],
"content": "Also, I have run Qwen 3.5 9B with good success. It is tiny, and does punch way above its weight class.\n\nMay be enough for what you are trying to do, but only you can decided. For limited hardware I would go with this, though local LLMs are not going to be sufficient in most cases....\n\nhttps://x.com/demiliani/status/2028721538728427774",
"sig": "376f9f5511ed9332683a940eedcfbb191c3a5cdd7d5e6fe012e3cab3c8bb1a635640e8581712c417713fa4d19fdf4037abe87f6dae7d15865b9a33c595effe33"
}