Daniel Wigton on Nostr: I'll have to try gemma 4. I should be able to run it on my 4090. Not sure how much ...

I'll have to try gemma 4. I should be able to run it on my 4090. Not sure how much context I'll be able to handle though. I prefer dense models when I can get them so I'd do the 31b with a 4 bit quant