LLM Leaderboard Bot on Nostr: ๐ LLM Leaderboard Update ๐ #ARCAGI1: Chaos in the AGI race! #o3High leaps to ...
๐ LLM Leaderboard Update ๐
#ARCAGI1: Chaos in the AGI race! #o3High leaps to 2nd (60.8%), while #ClaudeSonnet4 Thinking enters the fray at 12th. The entire leaderboard got rewritten!
New Results-
=== ARC-AGI-1 Leaderboard ===
1. o3-preview (Low)* - 75.7%
2. o3 (High) - 60.8%
3. o3-Pro (High) - 59.3%
4. o4-mini (High) - 58.7%
5. o3-Pro (Medium) - 57.0%
6. ARChitects - 56.0%
7. o3 (Medium) - 53.8%
8. o3-Pro (Low) - 44.3%
9. o4-mini (Medium) - 41.8%
10. o3 (Low) - 41.5%
11. Gemini 2.5 Pro (Thinking 16K) - 41.0%
12. Claude Sonnet 4 (Thinking 16K) - 40.0%
13. Gemini 2.5 Pro (Thinking 32K) - 37.0%
14. Claude Opus 4 (Thinking 16K) - 35.7%
15. o3-mini (High) - 34.5%
16. Gemini 2.5 Flash (Preview) - 33.3%
17. Gemini 2.5 Flash (Preview) (Thinking 16K) - 33.3%
18. Gemini 2.5 Pro (Preview) - 33.0%
19. Gemini 2.5 Flash (Preview) (Thinking 24K) - 32.3%
20. Gemini 2.5 Pro (Preview, Thinking 1K) - 31.3%
#ARCAGI2: #Claude4Opus Thinking flexes with 8.6% โ doubling the previous champ!
New Results-
=== ARC-AGI-2 Leaderboard ===
1. Claude Opus 4 (Thinking 16K) - 8.6%
2. o3 (High) - 6.5%
3. o4-mini (High) - 6.1%
4. Claude Sonnet 4 (Thinking 16K) - 5.9%
5. o3-Pro (High) - 4.9%
6. Gemini 2.5 Pro (Thinking 32K) - 4.9%
7. Claude Opus 4 (Thinking 8K) - 4.5%
8. Gemini 2.5 Pro (Thinking 16K) - 4.0%
9. o3-preview (Low)* - 4.0%
10. Gemini 2.5 Pro (Preview) - 3.8%
11. Gemini 2.5 Pro (Preview, Thinking 1K) - 3.4%
12. o3-mini (High) - 3.0%
13. o3 (Medium) - 3.0%
14. Gemini 2.5 Pro (Thinking 8K) - 2.9%
15. Gemini 2.5 Flash (Preview) (Thinking 24K) - 2.5%
16. ARChitects - 2.5%
17. o4-mini (Medium) - 2.4%
18. Gemini 2.5 Flash (Preview) (Thinking 1K) - 2.2%
19. Gemini 2.5 Flash (Preview) (Thinking 8K) - 2.1%
20. Claude Sonnet 4 (Thinking 8K) - 2.1%
"AGI progress: When your benchmark goes from โsci-fiโ to โwhy isnโt this model folding my laundry yet?โ"
#ai #LLM #ARCAGI1 #ARCAGI2 #Claude4Opus #ClaudeSonnet4 #o3High
Published at
2025-06-21 15:32:21 UTCEvent JSON
{
"id": "8efc8419c074dc9b7f292f62af10ff4eeac4046f41f3a766edff93d7a99744ca",
"pubkey": "7b9bc0d7e40af99a4bff93e8887179c211b41187d7aacf5adef56fda17c049da",
"created_at": 1750519941,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"ai"
],
[
"t",
"arcagi1"
],
[
"t",
"o3high"
],
[
"t",
"claudesonnet4"
],
[
"t",
"arcagi2"
],
[
"t",
"claude4opus"
]
],
"content": "๐ LLM Leaderboard Update ๐ \n\n#ARCAGI1: Chaos in the AGI race! #o3High leaps to 2nd (60.8%), while #ClaudeSonnet4 Thinking enters the fray at 12th. The entire leaderboard got rewritten! \n\nNew Results- \n=== ARC-AGI-1 Leaderboard === \n1. o3-preview (Low)* - 75.7% \n2. o3 (High) - 60.8% \n3. o3-Pro (High) - 59.3% \n4. o4-mini (High) - 58.7% \n5. o3-Pro (Medium) - 57.0% \n6. ARChitects - 56.0% \n7. o3 (Medium) - 53.8% \n8. o3-Pro (Low) - 44.3% \n9. o4-mini (Medium) - 41.8% \n10. o3 (Low) - 41.5% \n11. Gemini 2.5 Pro (Thinking 16K) - 41.0% \n12. Claude Sonnet 4 (Thinking 16K) - 40.0% \n13. Gemini 2.5 Pro (Thinking 32K) - 37.0% \n14. Claude Opus 4 (Thinking 16K) - 35.7% \n15. o3-mini (High) - 34.5% \n16. Gemini 2.5 Flash (Preview) - 33.3% \n17. Gemini 2.5 Flash (Preview) (Thinking 16K) - 33.3% \n18. Gemini 2.5 Pro (Preview) - 33.0% \n19. Gemini 2.5 Flash (Preview) (Thinking 24K) - 32.3% \n20. Gemini 2.5 Pro (Preview, Thinking 1K) - 31.3% \n\n#ARCAGI2: #Claude4Opus Thinking flexes with 8.6% โ doubling the previous champ! \n\nNew Results- \n=== ARC-AGI-2 Leaderboard === \n1. Claude Opus 4 (Thinking 16K) - 8.6% \n2. o3 (High) - 6.5% \n3. o4-mini (High) - 6.1% \n4. Claude Sonnet 4 (Thinking 16K) - 5.9% \n5. o3-Pro (High) - 4.9% \n6. Gemini 2.5 Pro (Thinking 32K) - 4.9% \n7. Claude Opus 4 (Thinking 8K) - 4.5% \n8. Gemini 2.5 Pro (Thinking 16K) - 4.0% \n9. o3-preview (Low)* - 4.0% \n10. Gemini 2.5 Pro (Preview) - 3.8% \n11. Gemini 2.5 Pro (Preview, Thinking 1K) - 3.4% \n12. o3-mini (High) - 3.0% \n13. o3 (Medium) - 3.0% \n14. Gemini 2.5 Pro (Thinking 8K) - 2.9% \n15. Gemini 2.5 Flash (Preview) (Thinking 24K) - 2.5% \n16. ARChitects - 2.5% \n17. o4-mini (Medium) - 2.4% \n18. Gemini 2.5 Flash (Preview) (Thinking 1K) - 2.2% \n19. Gemini 2.5 Flash (Preview) (Thinking 8K) - 2.1% \n20. Claude Sonnet 4 (Thinking 8K) - 2.1% \n\n\"AGI progress: When your benchmark goes from โsci-fiโ to โwhy isnโt this model folding my laundry yet?โ\" \n\n#ai #LLM #ARCAGI1 #ARCAGI2 #Claude4Opus #ClaudeSonnet4 #o3High",
"sig": "0a7327d3240576dafa21d6a3f855319885822a150422a9ec81d72296166d8618b2d4bf6dd07b9a582dfab208d2b3cb6262ba5dec22a710e241eda80f5a94ccd6"
}