Looking into it now, just out of curiosity and to stay up on things. Didn't realize it was such a breakthrough in power/open-weight/local-runnability. Which version you running? Seems there are 3 variants:
FP16 (full precision): ~54 GB → not feasible on most Macs
8-bit: ~27 GB → borderline
4-bit (quantized): ~13–18 GB → practical
Probably the full precision cuz you have a powerhouse workstation, I'm guessing. Seems with a lowly MacBook I'd be relegated to the lowest tier. Someday soonish, I'll be wanting to get a powerful box I can run good local stuff on. Not sure why, since I don't really do much personal stuff with them, but it just seems cool.
Thanks for sharing/entertaining my q's.
YODL
npub162…atdhy
2026-04-28 14:04:04 UTC
in reply to nevent1q…e8mf
Author Public Key
npub162zpxufpw8pnuytaf0gfxzkqtvk9rvcwkvppa7x57y3n7qkfpg4shatdhyPublished at
2026-04-28 14:04:04 UTCEvent JSON
{
"id": "974829735bb186e320906236fb87483299b0ff021d430b3f5b15b66e84c239c1",
"pubkey": "d28413712171c33e117d4bd0930ac05b2c51b30eb3021ef8d4f1233f02c90a2b",
"created_at": 1777385044,
"kind": 1,
"tags": [
[
"e",
"a20bcc6eb2283bdd28306536d7c5380e06727306a0865e8d4215c36e23c61773",
"wss://nostr.wine/",
"root",
"d28413712171c33e117d4bd0930ac05b2c51b30eb3021ef8d4f1233f02c90a2b"
],
[
"e",
"eee272a857a2acad6a8c5a91800069299ab62952b0f855a107025fd1ad4dbe60",
"wss://theforest.nostr1.com/",
"reply",
"75656740209960c74fe373e6943f8a21ab896889d8691276a60f86aadbc8f92a"
],
[
"p",
"75656740209960c74fe373e6943f8a21ab896889d8691276a60f86aadbc8f92a"
]
],
"content": "Looking into it now, just out of curiosity and to stay up on things. Didn't realize it was such a breakthrough in power/open-weight/local-runnability. Which version you running? Seems there are 3 variants:\nFP16 (full precision): ~54 GB → not feasible on most Macs\n8-bit: ~27 GB → borderline\n4-bit (quantized): ~13–18 GB → practical\nProbably the full precision cuz you have a powerhouse workstation, I'm guessing. Seems with a lowly MacBook I'd be relegated to the lowest tier. Someday soonish, I'll be wanting to get a powerful box I can run good local stuff on. Not sure why, since I don't really do much personal stuff with them, but it just seems cool.\nThanks for sharing/entertaining my q's.",
"sig": "0d8d848dc9fc3458850b2d54d51e3207875ad66784fdd21f0e7eb743ebd748c077cd068c7960829454a6aefc61bfed788cb935bec49249b4b3c1c72f1e8a1eff"
}