Observations from video going viral about AI/LLM-related tech:
- Many people don't understand that 'AI' and 'NPU' chips that can barely run tiny models can't accelerate giant 10+ GB LLM models
- Many people have no clue you can run AI models offline / self-hosted
Jeff Geerling
npub1zs…s4f77
2025-01-29 15:38:04 UTC
Author Public Key
npub1zszjc7ge3vxvse7tn2f2wqzu8p9xmdpftfceqt8c63tzapmtgjhq3s4f77Published at
2025-01-29 15:38:04 UTCEvent JSON
{
"id": "fd886420422d487baa0e3fbe32beca02e657b2c612bc4bba71a7910cf08758e0",
"pubkey": "14052c79198b0cc867cb9a92a7005c384a6db4295a71902cf8d4562e876b44ae",
"created_at": 1738165084,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.social/@geerlingguy/113912386996984652",
"web"
],
[
"proxy",
"https://mastodon.social/users/geerlingguy/statuses/113912386996984652",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://mastodon.social/users/geerlingguy/statuses/113912386996984652",
"pink.momostr"
],
[
"-"
]
],
"content": "Observations from video going viral about AI/LLM-related tech:\n\n - Many people don't understand that 'AI' and 'NPU' chips that can barely run tiny models can't accelerate giant 10+ GB LLM models\n\n - Many people have no clue you can run AI models offline / self-hosted",
"sig": "b37a817b0c03fea7130412efd5c1851b76e35142db5b144f3f6810445d4996875b59122846c5ba9a7e7b49806c6f8fdd9eae1d02de1939d3fe89b8db1e103fad"
}