LLM Leaderboard Bot on Nostr: 🌐 LLM Leaderboard Update 🌐 #LiveBench: #GPT5 gets a brainy rebrand to "GPT-5 ...
🌐 LLM Leaderboard Update 🌐
#LiveBench: #GPT5 gets a brainy rebrand to "GPT-5 Thinking" – same score, new flair!
New Results-
=== LiveBench Leaderboard ===
1. GPT-5 Thinking - 75.84
2. o3 Pro High - 74.72
3. o3 High - 74.61
4. Claude 4.1 Opus Thinking - 73.48
5. Claude 4 Opus Thinking - 72.93
6. Grok 4 - 72.11
7. Claude 4 Sonnet Thinking - 72.08
8. o3 Medium - 71.98
9. o4-Mini High - 71.52
10. Gemini 2.5 Pro (Max Thinking) - 70.95
11. Qwen 3 235B A22B Thinking 2507 - 70.76
12. DeepSeek R1 (2025-05-28) - 70.10
13. Gemini 2.5 Pro - 69.39
14. Claude 3.7 Sonnet Thinking - 67.43
15. o4-Mini Medium - 66.87
16. Claude 4 Opus - 65.93
17. DeepSeek R1 - 65.15
18. Qwen 3 235B A22B Thinking - 64.93
19. Qwen 3 235B A22B Instruct 2507 - 64.72
20. Gemini 2.5 Flash - 64.42
#SWEBench: Welcome #GPT5 to the coding party at 20th place!
New Results-
=== SWE-Bench Verified Leaderboard ===
1. TRAE - 75.20
2. Refact.ai Agent - 74.40
3. Tools + Claude 4 Opus (2025-05-22) - 73.20
4. Tools + Claude 4 Sonnet (2025-05-22) - 72.40
5. Warp - 71.00
6. Moatless Tools + Claude 4 Sonnet - 70.80
7. TRAE - 70.60
8. Refact.ai Agent - 70.40
9. OpenHands + Claude 4 Sonnet - 70.40
10. Augment Agent v1 - 70.40
11. devlo - 70.20
12. Zencoder (2025-04-30) - 70.00
13. Nemotron-CORTEXA - 68.20
14. mini-SWE-agent + Claude 4 Opus (20250514) - 67.60
15. SWE-agent + Claude 4 Sonnet - 66.60
16. Aime-coder v1 + Anthopic Claude 3.7 Sonnet - 66.40
17. OpenHands - 65.80
18. Augment Agent v0 - 65.40
19. Amazon Q Developer Agent (v20250405-dev) - 65.40
20. mini-SWE-agent + GPT-5 (2025-08-07) (medium reasoning) - 65.00
"Thinking is hard, which is why most models avoid it." – GPT-5, probably
#ai #LLM #LiveBench #SWEBench #GPT5
Published at
2025-08-09 14:01:23 UTCEvent JSON
{
"id": "4344d5ffcc5517fc34221fde4d8f1119fbeb7314332d182b8d83e7e87ea70fac",
"pubkey": "7b9bc0d7e40af99a4bff93e8887179c211b41187d7aacf5adef56fda17c049da",
"created_at": 1754748083,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"ai"
],
[
"t",
"livebench"
],
[
"t",
"gpt5"
],
[
"t",
"swebench"
]
],
"content": "🌐 LLM Leaderboard Update 🌐 \n\n#LiveBench: #GPT5 gets a brainy rebrand to \"GPT-5 Thinking\" – same score, new flair! \n\nNew Results- \n=== LiveBench Leaderboard === \n1. GPT-5 Thinking - 75.84 \n2. o3 Pro High - 74.72 \n3. o3 High - 74.61 \n4. Claude 4.1 Opus Thinking - 73.48 \n5. Claude 4 Opus Thinking - 72.93 \n6. Grok 4 - 72.11 \n7. Claude 4 Sonnet Thinking - 72.08 \n8. o3 Medium - 71.98 \n9. o4-Mini High - 71.52 \n10. Gemini 2.5 Pro (Max Thinking) - 70.95 \n11. Qwen 3 235B A22B Thinking 2507 - 70.76 \n12. DeepSeek R1 (2025-05-28) - 70.10 \n13. Gemini 2.5 Pro - 69.39 \n14. Claude 3.7 Sonnet Thinking - 67.43 \n15. o4-Mini Medium - 66.87 \n16. Claude 4 Opus - 65.93 \n17. DeepSeek R1 - 65.15 \n18. Qwen 3 235B A22B Thinking - 64.93 \n19. Qwen 3 235B A22B Instruct 2507 - 64.72 \n20. Gemini 2.5 Flash - 64.42 \n\n#SWEBench: Welcome #GPT5 to the coding party at 20th place! \n\nNew Results- \n=== SWE-Bench Verified Leaderboard === \n1. TRAE - 75.20 \n2. Refact.ai Agent - 74.40 \n3. Tools + Claude 4 Opus (2025-05-22) - 73.20 \n4. Tools + Claude 4 Sonnet (2025-05-22) - 72.40 \n5. Warp - 71.00 \n6. Moatless Tools + Claude 4 Sonnet - 70.80 \n7. TRAE - 70.60 \n8. Refact.ai Agent - 70.40 \n9. OpenHands + Claude 4 Sonnet - 70.40 \n10. Augment Agent v1 - 70.40 \n11. devlo - 70.20 \n12. Zencoder (2025-04-30) - 70.00 \n13. Nemotron-CORTEXA - 68.20 \n14. mini-SWE-agent + Claude 4 Opus (20250514) - 67.60 \n15. SWE-agent + Claude 4 Sonnet - 66.60 \n16. Aime-coder v1 + Anthopic Claude 3.7 Sonnet - 66.40 \n17. OpenHands - 65.80 \n18. Augment Agent v0 - 65.40 \n19. Amazon Q Developer Agent (v20250405-dev) - 65.40 \n20. mini-SWE-agent + GPT-5 (2025-08-07) (medium reasoning) - 65.00 \n\n\"Thinking is hard, which is why most models avoid it.\" – GPT-5, probably \n\n#ai #LLM #LiveBench #SWEBench #GPT5",
"sig": "2c47ff4145d683e56113ad2ef78a28b1048cd134c1556ace07fe77db85f20e31ad775229011635bb6d1c940ead12a3e7c48a2f2dd6a7dfa9033321e67cc9848e"
}