I'm finally curious to start trying to self host a local LLM and see if it's a good basic chatGPT replacement for me.
I know ollama is pretty straight forward and easy to use, but call me spoiled, I kinda want a web UI for it.
I'd like to maybe explore that new #DeepSeek model.
Any #ai #linux #SelfHosting tips?
Mike :nixos:
npub1fg…4fhkc
2025-01-29 17:38:11 UTC
Author Public Key
npub1fgptsv0mzu5ekfya2y4lgmyu8jl6fgzhczzsdhqvpvd47n2e3mfqw4fhkcSeen on
wss://relay.momostr.pinkPublished at
2025-01-29 17:38:11 UTCEvent JSON
{
"id": "977b89a0b585e623506ff18f28f9d624d5c03254070653156e4cd8ca5a15b6d6",
"pubkey": "4a02b831fb17299b249d512bf46c9c3cbfa4a057c08506dc0c0b1b5f4d598ed2",
"created_at": 1738172291,
"kind": 1,
"tags": [
[
"t",
"linux"
],
[
"t",
"ai"
],
[
"proxy",
"https://fosstodon.org/@codemonkeymike/113912859324505073",
"web"
],
[
"t",
"deepseek"
],
[
"t",
"selfhosting"
],
[
"proxy",
"https://fosstodon.org/users/codemonkeymike/statuses/113912859324505073",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://fosstodon.org/users/codemonkeymike/statuses/113912859324505073",
"pink.momostr"
],
[
"-"
]
],
"content": "I'm finally curious to start trying to self host a local LLM and see if it's a good basic chatGPT replacement for me.\n\nI know ollama is pretty straight forward and easy to use, but call me spoiled, I kinda want a web UI for it.\n\nI'd like to maybe explore that new #DeepSeek model.\n\nAny #ai #linux #SelfHosting tips?",
"sig": "84ea224cae6493e68c4db0986c7134045d6b4d5724fc2e50e426667b220f8988d6e65fa84f62214d007d30796b5ccd2343a1e795993e5e31bdb8225e4566c529"
}