What are you running? I am in the process of switching from ollama to lama.cpp to see if I can get at bit more speed with longer context out of qwen3.6:27b
I have to go to a 4bit kv cache to get it done though.
Daniel Wigton
npub1w4…q30zp
2026-05-19 18:10:43 UTC
in reply to nevent1q…qp99
Author Public Key
npub1w4jkwspqn9svwnlrw0nfg0u2yx4cj6yfmp53ya4xp7r24k7gly4qaq30zpSeen on
wss://theforest.nostr1.comPublished at
2026-05-19 18:10:43 UTCEvent JSON
{
"id": "d63c67ad1cece8b08118339f7e58dd7f8f47e507574816847343b32720f19d4e",
"pubkey": "75656740209960c74fe373e6943f8a21ab896889d8691276a60f86aadbc8f92a",
"created_at": 1779214243,
"kind": 1,
"tags": [
[
"alt",
"A short note: What are you running? I am in the process of switc..."
],
[
"e",
"694e18c193755567577504247b85ffe395587b123551ad6eea32b894346dee85",
"wss://theforest.nostr1.com/",
"root",
"036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58"
],
[
"p",
"036533caa872376946d4e4fdea4c1a0441eda38ca2d9d9417bb36006cbaabf58",
"wss://relay.primal.net/"
],
[
"r",
"https://lama.cpp/"
],
[
"client",
"Amethyst"
]
],
"content": "What are you running? I am in the process of switching from ollama to lama.cpp to see if I can get at bit more speed with longer context out of qwen3.6:27b\n\nI have to go to a 4bit kv cache to get it done though.",
"sig": "43397d5e377d635cec54822afee6dfb281c024018704e297763646b99a36403d776cb28018befae5f0f658632e215ba3680828ab4d7826ba4533a70e455b0813"
}