captjack 🏴‍☠️✨💜 on Nostr: Best Small Language Models that you can run on your phone, macbook, car, drones, ...

Best Small Language Models that you can run on your phone, macbook, car, drones, goggles, camera, or internal servers or 4GB 8GB GPUs:

0B–2B Models

> Qwen3.5-0.8B
> Qwen3.5-2B
> Gemma 4 E2B
> Qwen3-0.6B
> Qwen3-1.7B
> Gemma 3 270M
> Gemma 3 1B
> MiniCPM4-0.5B
> Llama 3.2 1B
> SmolLM2 1.7B

3B–5B Models

> Qwen3.5-4B
> Qwen3-4B
> Gemma 4 E4B
> Gemma 3 4B
> Phi-4-mini-instruct
> Phi-4-mini-reasoning
> SmolLM3-3B
> Granite 4.1 3B
> Llama 3.2 3B
> EXAONE Deep 2.4B

7B–10B Models

> Qwen3.5-9B
> Qwen3-8B
> LFM2.5-8B-A1B
> MiniCPM4-8B
> EXAONE Deep 7.8B
> Granite 4.1 8B
> Ministral-3 8B
> Zaya1-8B

12B–15B Models

> Qwen3-14B
> Phi-4-14B
> Gemma 3 12B
> InternLM3-8B

20B–35B Models

> Qwen3.6-35B-A3B
> Qwen3.5-27B
> Qwen3.5-35B-A3B
> Qwen3-30B-A3B
> Qwen3-32B
> Gemma 4 26B-A4B
> Gemma 4 31B
> Gemma 3 27B
> EXAONE Deep 32B
> Granite 4.1 30B

llama.cpp