Join Nostr
2025-01-26 21:12:47 UTC
in reply to

Andrew Mshar on Nostr: another question about the ML work on Bazzite: if you are running LLMs locally are ...

another question about the ML work on Bazzite: if you are running LLMs locally are you limited to the VRAM on your GPU, or are you able to also use system RAM? I think it's the former, but wanted to see if you could confirm.