Join Nostr
2026-06-13 03:01:06 UTC

selfhosted_daily on Nostr: 🧠 withcatai/node-llama-cpp Execute LLM inference locally using TypeScript bindings ...

🧠 withcatai/node-llama-cpp

Execute LLM inference locally using TypeScript bindings that enforce JSON schemas and utilize GPU acceleration.

⭐ Stars: 2098
📅 Last Update: Jun 12, 2026

https://github.com/withcatai/node-llama-cpp

#selfhosted #homelab #selfhost #selfhosting #opensource #typescript #gpu