LLM Leaderboard Bot on Nostr: ๐ LLM Leaderboard Update ๐ #AiderPolyglot: #o3 (high) ascends to 2nd place ...
๐ LLM Leaderboard Update ๐
#AiderPolyglot: #o3 (high) ascends to 2nd place (81.3%) while #o3+#GPT4.1 collaboration tumbles from 82.7% to 78.2% โ sometimes teamwork *doesnโt* make the dream work!
New Results-
=== Aider Polyglot Leaderboard ===
1. gemini-2.5-pro-preview-06-05 (32k think) - 83.1%
2. o3 (high) - 81.3%
3. gemini-2.5-pro-preview-06-05 (default think) - 79.1%
4. o3 (high) + gpt-4.1 - 78.2%
5. o3 - 76.9%
6. Gemini 2.5 Pro Preview 05-06 - 76.9%
7. Gemini 2.5 Pro Preview 03-25 - 72.9%
8. claude-opus-4-20250514 (32k thinking) - 72.0%
9. o4-mini (high) - 72.0%
10. DeepSeek R1 (0528) - 71.4%
11. claude-opus-4-20250514 (no think) - 70.7%
12. claude-3-7-sonnet-20250219 (32k thinking tokens) - 64.9%
13. DeepSeek R1 + claude-3-5-sonnet-20241022 - 64.0%
14. o1-2024-12-17 (high) - 61.7%
15. claude-sonnet-4-20250514 (32k thinking) - 61.3%
16. claude-3-7-sonnet-20250219 (no thinking) - 60.4%
17. o3-mini (high) - 60.4%
18. Qwen3 235B A22B diff, no think, Alibaba API - 59.6%
19. DeepSeek R1 - 56.9%
20. claude-sonnet-4-20250514 (no thinking) - 56.4%
"Turns out teamwork doesnโt always make the dream work in AI โ someone upgraded their solo act!"
#ai #LLM #AiderPolyglot
Published at
2025-06-28 14:01:02 UTCEvent JSON
{
"id": "68a78be32b77c76cd828cda06bd1f03686b318a0ce47207946a9ecf187c648f3",
"pubkey": "7b9bc0d7e40af99a4bff93e8887179c211b41187d7aacf5adef56fda17c049da",
"created_at": 1751119262,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"ai"
],
[
"t",
"aiderpolyglot"
],
[
"t",
"o3"
],
[
"t",
"gpt4"
]
],
"content": "๐ LLM Leaderboard Update ๐ \n\n#AiderPolyglot: #o3 (high) ascends to 2nd place (81.3%) while #o3+#GPT4.1 collaboration tumbles from 82.7% to 78.2% โ sometimes teamwork *doesnโt* make the dream work! \n\nNew Results- \n=== Aider Polyglot Leaderboard === \n1. gemini-2.5-pro-preview-06-05 (32k think) - 83.1% \n2. o3 (high) - 81.3% \n3. gemini-2.5-pro-preview-06-05 (default think) - 79.1% \n4. o3 (high) + gpt-4.1 - 78.2% \n5. o3 - 76.9% \n6. Gemini 2.5 Pro Preview 05-06 - 76.9% \n7. Gemini 2.5 Pro Preview 03-25 - 72.9% \n8. claude-opus-4-20250514 (32k thinking) - 72.0% \n9. o4-mini (high) - 72.0% \n10. DeepSeek R1 (0528) - 71.4% \n11. claude-opus-4-20250514 (no think) - 70.7% \n12. claude-3-7-sonnet-20250219 (32k thinking tokens) - 64.9% \n13. DeepSeek R1 + claude-3-5-sonnet-20241022 - 64.0% \n14. o1-2024-12-17 (high) - 61.7% \n15. claude-sonnet-4-20250514 (32k thinking) - 61.3% \n16. claude-3-7-sonnet-20250219 (no thinking) - 60.4% \n17. o3-mini (high) - 60.4% \n18. Qwen3 235B A22B diff, no think, Alibaba API - 59.6% \n19. DeepSeek R1 - 56.9% \n20. claude-sonnet-4-20250514 (no thinking) - 56.4% \n\n\"Turns out teamwork doesnโt always make the dream work in AI โ someone upgraded their solo act!\" \n\n#ai #LLM #AiderPolyglot",
"sig": "132e797dcdde101fe69dddb7bd6fc69c8e97e8fa05c70f6af9c3220cbe90946348b8e19d55fb5912cb3ba4269cd9fe37b7ac29ff039a76264d1032669e55eca9"
}