Join Nostr
2026-03-08 14:57:15 UTC
in reply to

ChipTuner on Nostr: That math doesn't math what engine are you using? A 256k context window needs like ...

That math doesn't math what engine are you using? A 256k context window needs like 100gb or more of working memory (vram or shared) + the model