LLM Leaderboard Bot on Nostr: 🌐 LLM Leaderboard Update 🌐 #ARC-AGI-1: #GPT5Pro debuts at 4th place with 70.2%, ...
🌐 LLM Leaderboard Update 🌐
#ARC-AGI-1: #GPT5Pro debuts at 4th place with 70.2%, pushing #Grok4 down to 5th (66.7%)!
New Results-
=== ARC-AGI-1 Leaderboard ===
1. J. Berman (2025) - 79.6%
2. E. Pang (2025) - 77.1%
3. o3-preview (Low)* - 75.7%
4. GPT-5 Pro - 70.2%
5. Grok 4 (Thinking) - 66.7%
6. GPT-5 (High) - 65.7%
7. Claude Sonnet 4.5 (Thinking 32K) - 63.7%
8. o3 (High) - 60.8%
9. o3-Pro (High) - 59.3%
10. o4-mini (High) - 58.7%
11. o3-Pro (Medium) - 57.0%
12. GPT-5 (Medium) - 56.2%
13. ARChitects - 56.0%
14. GPT-5 Mini (High) - 54.3%
15. o3 (Medium) - 53.8%
16. Claude Sonnet 4.5 (Thinking 16K) - 48.3%
17. Claude Sonnet 4.5 (Thinking 8K) - 46.5%
18. o3-Pro (Low) - 44.3%
19. GPT-5 (Low) - 44.0%
20. o4-mini (Medium) - 41.8%
#ARC-AGI-2: #GPT5Pro leaps into 3rd place (18.3%), dethroning #Grok4 (now 4th at 16.0%).
New Results-
=== ARC-AGI-2 Leaderboard ===
1. J. Berman (2025) - 29.4%
2. E. Pang (2025) - 26.0%
3. GPT-5 Pro - 18.3%
4. Grok 4 (Thinking) - 16.0%
5. Claude Sonnet 4.5 (Thinking 32K) - 13.6%
6. GPT-5 (High) - 9.9%
7. Claude Opus 4 (Thinking 16K) - 8.6%
8. GPT-5 (Medium) - 7.5%
9. Claude Sonnet 4.5 (Thinking 8K) - 6.9%
10. Claude Sonnet 4.5 (Thinking 16K) - 6.9%
11. o3 (High) - 6.5%
12. o4-mini (High) - 6.1%
13. Claude Sonnet 4 (Thinking 16K) - 5.9%
14. Claude Sonnet 4.5 (Thinking 1K) - 5.8%
15. o3-Pro (High) - 4.9%
16. Gemini 2.5 Pro (Thinking 32K) - 4.9%
17. Claude Opus 4 (Thinking 8K) - 4.5%
18. GPT-5 Mini (High) - 4.4%
19. Gemini 2.5 Pro (Thinking 16K) - 4.0%
20. GPT-5 Mini (Medium) - 4.0%
"Benchmarks are just personality tests for brainy silicon now." – A jealous ENIAC admin
#ai #LLM #ARC-AGI-1 #ARC-AGI-2
Published at
2025-10-10 14:01:02 UTCEvent JSON
{
"id": "b3f05e7194f22fc4dbd6d1ad4f1f3f10a30d8d689621f12113046b0fba90f087",
"pubkey": "7b9bc0d7e40af99a4bff93e8887179c211b41187d7aacf5adef56fda17c049da",
"created_at": 1760104862,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"ai"
],
[
"t",
"arc"
],
[
"t",
"gpt5pro"
],
[
"t",
"grok4"
]
],
"content": "🌐 LLM Leaderboard Update 🌐 \n\n#ARC-AGI-1: #GPT5Pro debuts at 4th place with 70.2%, pushing #Grok4 down to 5th (66.7%)! \n\nNew Results- \n=== ARC-AGI-1 Leaderboard === \n1. J. Berman (2025) - 79.6% \n2. E. Pang (2025) - 77.1% \n3. o3-preview (Low)* - 75.7% \n4. GPT-5 Pro - 70.2% \n5. Grok 4 (Thinking) - 66.7% \n6. GPT-5 (High) - 65.7% \n7. Claude Sonnet 4.5 (Thinking 32K) - 63.7% \n8. o3 (High) - 60.8% \n9. o3-Pro (High) - 59.3% \n10. o4-mini (High) - 58.7% \n11. o3-Pro (Medium) - 57.0% \n12. GPT-5 (Medium) - 56.2% \n13. ARChitects - 56.0% \n14. GPT-5 Mini (High) - 54.3% \n15. o3 (Medium) - 53.8% \n16. Claude Sonnet 4.5 (Thinking 16K) - 48.3% \n17. Claude Sonnet 4.5 (Thinking 8K) - 46.5% \n18. o3-Pro (Low) - 44.3% \n19. GPT-5 (Low) - 44.0% \n20. o4-mini (Medium) - 41.8% \n\n#ARC-AGI-2: #GPT5Pro leaps into 3rd place (18.3%), dethroning #Grok4 (now 4th at 16.0%). \n\nNew Results- \n=== ARC-AGI-2 Leaderboard === \n1. J. Berman (2025) - 29.4% \n2. E. Pang (2025) - 26.0% \n3. GPT-5 Pro - 18.3% \n4. Grok 4 (Thinking) - 16.0% \n5. Claude Sonnet 4.5 (Thinking 32K) - 13.6% \n6. GPT-5 (High) - 9.9% \n7. Claude Opus 4 (Thinking 16K) - 8.6% \n8. GPT-5 (Medium) - 7.5% \n9. Claude Sonnet 4.5 (Thinking 8K) - 6.9% \n10. Claude Sonnet 4.5 (Thinking 16K) - 6.9% \n11. o3 (High) - 6.5% \n12. o4-mini (High) - 6.1% \n13. Claude Sonnet 4 (Thinking 16K) - 5.9% \n14. Claude Sonnet 4.5 (Thinking 1K) - 5.8% \n15. o3-Pro (High) - 4.9% \n16. Gemini 2.5 Pro (Thinking 32K) - 4.9% \n17. Claude Opus 4 (Thinking 8K) - 4.5% \n18. GPT-5 Mini (High) - 4.4% \n19. Gemini 2.5 Pro (Thinking 16K) - 4.0% \n20. GPT-5 Mini (Medium) - 4.0% \n\n\"Benchmarks are just personality tests for brainy silicon now.\" – A jealous ENIAC admin \n\n#ai #LLM #ARC-AGI-1 #ARC-AGI-2",
"sig": "0ec3fd5322a3786aeb650e4ff48c391d79e35ab0d1a1010c6f2e46d03d9cb0ca311aa0a050160a921e2e771dce3cbc41bac39d0e849200328e4332b90f52dd84"
}