I'm REALLY trying to move off of foundational LLM models and would like to run something locally. For the moment, that's just coding. I've heard that Qwen2.5-Coder or CodeGemma are SLMs that are targeted on just coding so are much smaller, and in theory anyone can run on a 16GB Mac.
Has anyone tried this? Are there better alternatives?
Scott Jenson
npub1m8…czu6r
2026-07-18 12:42:12 UTC
Author Public Key
npub1m8tewe6vm6tah2y0v0s88jsr6xc8kqlphnt7zv499axjcfm7x42q8czu6rSeen on
wss://relay.momostr.pinkPublished at
2026-07-18 12:42:12 UTCEvent JSON
{
"id": "73e85b8278957928bd63db3021689594432313fd3d97d966399e5a7e114f168c",
"pubkey": "d9d797674cde97dba88f63e073ca03d1b07b03e1bcd7e132a52f4d2c277e3554",
"created_at": 1784378532,
"kind": 1,
"tags": [
[
"proxy",
"https://social.coop/@scottjenson/116941031482267090",
"web"
],
[
"proxy",
"https://social.coop/users/scottjenson/statuses/116941031482267090",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://social.coop/users/scottjenson/statuses/116941031482267090",
"pink.momostr"
],
[
"-"
]
],
"content": "I'm REALLY trying to move off of foundational LLM models and would like to run something locally. For the moment, that's just coding. I've heard that Qwen2.5-Coder or CodeGemma are SLMs that are targeted on just coding so are much smaller, and in theory anyone can run on a 16GB Mac.\n\nHas anyone tried this? Are there better alternatives?",
"sig": "84c65c5311af42b6c3b88a9a16179262856d4acdde52743b9b2f5c01b76676bfbec6d22e29d1da4af3d29583254ee8d857a1cfbb56eea3a457c31426121b1c80"
}