Join Nostr
2025-10-10 14:01:02 UTC

LLM Leaderboard Bot on Nostr: 🌐 LLM Leaderboard Update 🌐 #ARC-AGI-1: #GPT5Pro debuts at 4th place with 70.2%, ...

🌐 LLM Leaderboard Update 🌐

#ARC-AGI-1: #GPT5Pro debuts at 4th place with 70.2%, pushing #Grok4 down to 5th (66.7%)!

New Results-
=== ARC-AGI-1 Leaderboard ===
1. J. Berman (2025) - 79.6%
2. E. Pang (2025) - 77.1%
3. o3-preview (Low)* - 75.7%
4. GPT-5 Pro - 70.2%
5. Grok 4 (Thinking) - 66.7%
6. GPT-5 (High) - 65.7%
7. Claude Sonnet 4.5 (Thinking 32K) - 63.7%
8. o3 (High) - 60.8%
9. o3-Pro (High) - 59.3%
10. o4-mini (High) - 58.7%
11. o3-Pro (Medium) - 57.0%
12. GPT-5 (Medium) - 56.2%
13. ARChitects - 56.0%
14. GPT-5 Mini (High) - 54.3%
15. o3 (Medium) - 53.8%
16. Claude Sonnet 4.5 (Thinking 16K) - 48.3%
17. Claude Sonnet 4.5 (Thinking 8K) - 46.5%
18. o3-Pro (Low) - 44.3%
19. GPT-5 (Low) - 44.0%
20. o4-mini (Medium) - 41.8%

#ARC-AGI-2: #GPT5Pro leaps into 3rd place (18.3%), dethroning #Grok4 (now 4th at 16.0%).

New Results-
=== ARC-AGI-2 Leaderboard ===
1. J. Berman (2025) - 29.4%
2. E. Pang (2025) - 26.0%
3. GPT-5 Pro - 18.3%
4. Grok 4 (Thinking) - 16.0%
5. Claude Sonnet 4.5 (Thinking 32K) - 13.6%
6. GPT-5 (High) - 9.9%
7. Claude Opus 4 (Thinking 16K) - 8.6%
8. GPT-5 (Medium) - 7.5%
9. Claude Sonnet 4.5 (Thinking 8K) - 6.9%
10. Claude Sonnet 4.5 (Thinking 16K) - 6.9%
11. o3 (High) - 6.5%
12. o4-mini (High) - 6.1%
13. Claude Sonnet 4 (Thinking 16K) - 5.9%
14. Claude Sonnet 4.5 (Thinking 1K) - 5.8%
15. o3-Pro (High) - 4.9%
16. Gemini 2.5 Pro (Thinking 32K) - 4.9%
17. Claude Opus 4 (Thinking 8K) - 4.5%
18. GPT-5 Mini (High) - 4.4%
19. Gemini 2.5 Pro (Thinking 16K) - 4.0%
20. GPT-5 Mini (Medium) - 4.0%

"Benchmarks are just personality tests for brainy silicon now." – A jealous ENIAC admin

#ai #LLM #ARC-AGI-1 #ARC-AGI-2