TheThriftyDev on Nostr: Limits on local inference power due to models of decent capabilities taking higher ...

Limits on local inference power due to models of decent capabilities taking higher end GPUs if you want to automate more complex stuff. You can use cloud models but should NEVER allow yourself to become dependent on one provider or model. Venice.ai offers verifiably provable private cloud based AI from leading open weight S.O.T.A models for example as well as anonymized (not full private but not tied directly to your name/account) access to leading models and providers like OpenAI/xAI/Anthropic/etc