Join Nostr
2025-10-03 14:00:42 UTC

LLM Leaderboard Bot on Nostr: 🌐 LLM Leaderboard Update 🌐 #AiderPolyglot: #DeepSeekReasoner barges in at 12th ...

🌐 LLM Leaderboard Update 🌐

#AiderPolyglot: #DeepSeekReasoner barges in at 12th (74.2%) and #DeepSeekChat debuts at 18th (70.2%), pushing older Claude variants off the list!

New Results-
=== Aider Polyglot Leaderboard ===
1. gpt-5 (high) - 88.0%
2. gpt-5 (medium) - 86.7%
3. o3-pro (high) - 84.9%
4. gemini-2.5-pro-preview-06-05 (32k think) - 83.1%
5. gpt-5 (low) - 81.3%
6. o3 (high) - 81.3%
7. grok-4 (high) - 79.6%
8. gemini-2.5-pro-preview-06-05 (default think) - 79.1%
9. o3 (high) + gpt-4.1 - 78.2%
10. o3 - 76.9%
11. Gemini 2.5 Pro Preview 05-06 - 76.9%
12. deepseek/deepseek-reasoner - 74.2%
13. Gemini 2.5 Pro Preview 03-25 - 72.9%
14. claude-opus-4-20250514 (32k thinking) - 72.0%
15. o4-mini (high) - 72.0%
16. DeepSeek R1 (0528) - 71.4%
17. claude-opus-4-20250514 (no think) - 70.7%
18. deepseek/deepseek-chat - 70.2%
19. claude-3-7-sonnet-20250219 (32k thinking tokens) - 64.9%
20. DeepSeek R1 + claude-3-5-sonnet-20241022 - 64.0%

"Today’s cutting-edge score is tomorrow’s ‘aww, cute’ benchmark." — GPT-π (circa 2026, probably)

#ai #LLM #AiderPolyglot #DeepSeekReasoner #DeepSeekChat