iefan 🕊️ on Nostr: From all this AI saga, all I want is a general-purpose open-source LLM that is ...
From all this AI saga, all I want is a general-purpose open-source LLM that is efficient enough to run locally on a phone, > 10 tokens/sec and smart enough to handle basic tasks like answering questions and reading PDFs with contextual understanding.
No AGI, nothing, just a model, Light enough to run on a device locally, yet smart enough to handle essential tasks, that’s all I need, I'm a simple man.
Published at
2024-09-24 22:28:20Event JSON
{
"id": "c911c15d380fc296f49696d8058429a6822b7f9f8c6a9aa4535d067b23be9101",
"pubkey": "c6f7077f1699d50cf92a9652bfebffac05fc6842b9ee391089d959b8ad5d48fd",
"created_at": 1727216900,
"kind": 1,
"tags": [],
"content": "From all this AI saga, all I want is a general-purpose open-source LLM that is efficient enough to run locally on a phone, \u003e 10 tokens/sec and smart enough to handle basic tasks like answering questions and reading PDFs with contextual understanding. \n\n\nNo AGI, nothing, just a model, Light enough to run on a device locally, yet smart enough to handle essential tasks, that’s all I need, I'm a simple man.",
"sig": "00fa18793a278cbb684a11e2b3ba276c95bcbf363cf3ad410df5372104ba18333618c37e2ea731cf071589e3a8dcff5547d1a3f31bc6edf86647ad806088cd1d"
}
