Join Nostr
2026-08-29 18:35:16 UTC
in reply to

Troed Sångberg on Nostr: Let me quote myself: "consider LLMs to be an absolutely fantastic tool for all use ...

Let me quote myself: "consider LLMs to be an absolutely fantastic tool for all use cases that have a clear OK/NOK gate. That involves cybersec, sysadm, software dev, maths proofs etc. It does not include transcribing doctor's notes into patient journals, as a counter example."

LLMs are horribly bad at being databases. No one who knows anything about computer science thinks otherwise, no, not the people creating them either. Try it yourself: A good capable local LLM is about 20 GBs in size. With what you know about compression (Shannon's theorem) - can that file include all the knowledge on the planet?