Join Nostr
2025-07-30 08:40:12 UTC
in reply to

Fabio Manganiello on Nostr: nprofile1q…852zc is it ok if the LLM is an Ollama open model running on a desktop ...

is it ok if the LLM is an Ollama open model running on a desktop just next to me that I’ve repurposed as a server?

I have the same feeling of hate and mistrust towards the exploitative economic incentives behind modern-day AI. But I’ve also got a background in AI myself, and long before technobros took over it, and I feel even more betrayed by what they’ve turned my field into.

I still see useful applications for this tech (which doesn’t mean that LLM should be the only way of doing AI btw), and I’m wondering if running open models on machines that I need to keep on anyway because they host some of my other services can be deemed acceptable.