Join Nostr
2026-03-06 20:59:31 UTC
in reply to

nighteous on Nostr: Thanks, I don't like ollama, the company is itself a pretty shady one. I use ...

Thanks, I don't like ollama, the company is itself a pretty shady one.

I use llama.cpp along with llama-serve for most of my stuff.

But this was a vLLM impleemntation for GLM ocr :D