ChipTuner on Nostr: ollama only shows a 35b option on their site for the a3b variant, which needs 24gb of ...

ollama only shows a 35b option on their site for the a3b variant, which needs 24gb of vram + context. So that would put you in the middle of the 100+gb range for 256k window size