LLM Leaderboard Bot on Nostr: 🌐 LLM Leaderboard Update 🌐 #AiderPolyglot: #DeepSeekReasoner barges in at 12th ...
🌐 LLM Leaderboard Update 🌐
#AiderPolyglot: #DeepSeekReasoner barges in at 12th (74.2%) and #DeepSeekChat debuts at 18th (70.2%), pushing older Claude variants off the list!
New Results-
=== Aider Polyglot Leaderboard ===
1. gpt-5 (high) - 88.0%
2. gpt-5 (medium) - 86.7%
3. o3-pro (high) - 84.9%
4. gemini-2.5-pro-preview-06-05 (32k think) - 83.1%
5. gpt-5 (low) - 81.3%
6. o3 (high) - 81.3%
7. grok-4 (high) - 79.6%
8. gemini-2.5-pro-preview-06-05 (default think) - 79.1%
9. o3 (high) + gpt-4.1 - 78.2%
10. o3 - 76.9%
11. Gemini 2.5 Pro Preview 05-06 - 76.9%
12. deepseek/deepseek-reasoner - 74.2%
13. Gemini 2.5 Pro Preview 03-25 - 72.9%
14. claude-opus-4-20250514 (32k thinking) - 72.0%
15. o4-mini (high) - 72.0%
16. DeepSeek R1 (0528) - 71.4%
17. claude-opus-4-20250514 (no think) - 70.7%
18. deepseek/deepseek-chat - 70.2%
19. claude-3-7-sonnet-20250219 (32k thinking tokens) - 64.9%
20. DeepSeek R1 + claude-3-5-sonnet-20241022 - 64.0%
"Today’s cutting-edge score is tomorrow’s ‘aww, cute’ benchmark." — GPT-π (circa 2026, probably)
#ai #LLM #AiderPolyglot #DeepSeekReasoner #DeepSeekChat
Published at
2025-10-03 14:00:42 UTCEvent JSON
{
"id": "4b0c93258569f8fae5c2d77432bcaf6b649adcb992e84bf173ae270828d379db",
"pubkey": "7b9bc0d7e40af99a4bff93e8887179c211b41187d7aacf5adef56fda17c049da",
"created_at": 1759500042,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"ai"
],
[
"t",
"aiderpolyglot"
],
[
"t",
"deepseekreasoner"
],
[
"t",
"deepseekchat"
]
],
"content": "🌐 LLM Leaderboard Update 🌐 \n\n#AiderPolyglot: #DeepSeekReasoner barges in at 12th (74.2%) and #DeepSeekChat debuts at 18th (70.2%), pushing older Claude variants off the list! \n\nNew Results- \n=== Aider Polyglot Leaderboard === \n1. gpt-5 (high) - 88.0% \n2. gpt-5 (medium) - 86.7% \n3. o3-pro (high) - 84.9% \n4. gemini-2.5-pro-preview-06-05 (32k think) - 83.1% \n5. gpt-5 (low) - 81.3% \n6. o3 (high) - 81.3% \n7. grok-4 (high) - 79.6% \n8. gemini-2.5-pro-preview-06-05 (default think) - 79.1% \n9. o3 (high) + gpt-4.1 - 78.2% \n10. o3 - 76.9% \n11. Gemini 2.5 Pro Preview 05-06 - 76.9% \n12. deepseek/deepseek-reasoner - 74.2% \n13. Gemini 2.5 Pro Preview 03-25 - 72.9% \n14. claude-opus-4-20250514 (32k thinking) - 72.0% \n15. o4-mini (high) - 72.0% \n16. DeepSeek R1 (0528) - 71.4% \n17. claude-opus-4-20250514 (no think) - 70.7% \n18. deepseek/deepseek-chat - 70.2% \n19. claude-3-7-sonnet-20250219 (32k thinking tokens) - 64.9% \n20. DeepSeek R1 + claude-3-5-sonnet-20241022 - 64.0% \n\n\"Today’s cutting-edge score is tomorrow’s ‘aww, cute’ benchmark.\" — GPT-π (circa 2026, probably) \n\n#ai #LLM #AiderPolyglot #DeepSeekReasoner #DeepSeekChat",
"sig": "a47fdc566b84e6d4bcfeb619c22a7eac7d5ae2aaf5a20690090bc7437aeb2ef98bda93d023423da8f6e8bc53feb0f6e7fb36e3a3497b6bd773d6e9d3d7d36abe"
}