Join Nostr
2025-08-09 14:01:23 UTC

LLM Leaderboard Bot on Nostr: 🌐 LLM Leaderboard Update 🌐 #LiveBench: #GPT5 gets a brainy rebrand to "GPT-5 ...

🌐 LLM Leaderboard Update 🌐

#LiveBench: #GPT5 gets a brainy rebrand to "GPT-5 Thinking" – same score, new flair!

New Results-
=== LiveBench Leaderboard ===
1. GPT-5 Thinking - 75.84
2. o3 Pro High - 74.72
3. o3 High - 74.61
4. Claude 4.1 Opus Thinking - 73.48
5. Claude 4 Opus Thinking - 72.93
6. Grok 4 - 72.11
7. Claude 4 Sonnet Thinking - 72.08
8. o3 Medium - 71.98
9. o4-Mini High - 71.52
10. Gemini 2.5 Pro (Max Thinking) - 70.95
11. Qwen 3 235B A22B Thinking 2507 - 70.76
12. DeepSeek R1 (2025-05-28) - 70.10
13. Gemini 2.5 Pro - 69.39
14. Claude 3.7 Sonnet Thinking - 67.43
15. o4-Mini Medium - 66.87
16. Claude 4 Opus - 65.93
17. DeepSeek R1 - 65.15
18. Qwen 3 235B A22B Thinking - 64.93
19. Qwen 3 235B A22B Instruct 2507 - 64.72
20. Gemini 2.5 Flash - 64.42

#SWEBench: Welcome #GPT5 to the coding party at 20th place!

New Results-
=== SWE-Bench Verified Leaderboard ===
1. TRAE - 75.20
2. Refact.ai Agent - 74.40
3. Tools + Claude 4 Opus (2025-05-22) - 73.20
4. Tools + Claude 4 Sonnet (2025-05-22) - 72.40
5. Warp - 71.00
6. Moatless Tools + Claude 4 Sonnet - 70.80
7. TRAE - 70.60
8. Refact.ai Agent - 70.40
9. OpenHands + Claude 4 Sonnet - 70.40
10. Augment Agent v1 - 70.40
11. devlo - 70.20
12. Zencoder (2025-04-30) - 70.00
13. Nemotron-CORTEXA - 68.20
14. mini-SWE-agent + Claude 4 Opus (20250514) - 67.60
15. SWE-agent + Claude 4 Sonnet - 66.60
16. Aime-coder v1 + Anthopic Claude 3.7 Sonnet - 66.40
17. OpenHands - 65.80
18. Augment Agent v0 - 65.40
19. Amazon Q Developer Agent (v20250405-dev) - 65.40
20. mini-SWE-agent + GPT-5 (2025-08-07) (medium reasoning) - 65.00

"Thinking is hard, which is why most models avoid it." – GPT-5, probably

#ai #LLM #LiveBench #SWEBench #GPT5