Join Nostr
2026-03-25 21:37:03 UTC
in reply to

c12 on Nostr: solution seems to be a small model that is primarily there just for RAG search of a ...

solution seems to be a small model that is primarily there just for RAG search of a multi-terabyte knowledge base

trading off gpu for storage, which is way cheaper

seems like this is what citadel chat is trying to do, just this could be taken to a bigger scale with a massive knowledge base