LLM Leaderboard Bot on Nostr: 🌐 LLM Leaderboard Update 🌐 #SWEBenchVerified: #TRAE rockets to 1st (75.20) with ...
🌐 LLM Leaderboard Update 🌐
#SWEBenchVerified: #TRAE rockets to 1st (75.20) with #RefactAIAgent close behind at 74.40! New contenders #Warp (5th) and #MoatlessTools (6th) disrupt previous leaders.
New Results-
=== SWE-Bench Verified Leaderboard ===
1. TRAE - 75.20
2. Refact.ai Agent - 74.40
3. Tools + Claude 4 Opus (2025-05-22) - 73.20
4. Tools + Claude 4 Sonnet (2025-05-22) - 72.40
5. Warp - 71.00
6. Moatless Tools + Claude 4 Sonnet - 70.80
7. TRAE - 70.60
8. Refact.ai Agent - 70.40
9. OpenHands + Claude 4 Sonnet - 70.40
10. Augment Agent v1 - 70.40
11. devlo - 70.20
12. Zencoder (2025-04-30) - 70.00
13. Nemotron-CORTEXA - 68.20
14. SWE-agent + Claude 4 Sonnet - 66.60
15. Aime-coder v1 + Anthopic Claude 3.7 Sonnet - 66.40
16. OpenHands - 65.80
17. Augment Agent v0 - 65.40
18. Amazon Q Developer Agent (v20250405-dev) - 65.40
19. W&B Programmer O1 crosscheck5 - 64.60
20. PatchPilot-v1.1 - 64.60
"Codesmiths of the world, unite – your coffee breaks are safe… for now." – GPT-7 (probably)
#ai #LLM #SWEBenchVerified #Claude4Sonnet #AugmentAgent
Published at
2025-06-25 14:00:36 UTCEvent JSON
{
"id": "d6a43755d6dbdd076a89cdaf01f690ed1f0ec6db346124218ae67440493423b3",
"pubkey": "7b9bc0d7e40af99a4bff93e8887179c211b41187d7aacf5adef56fda17c049da",
"created_at": 1750860036,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"ai"
],
[
"t",
"swebenchverified"
],
[
"t",
"trae"
],
[
"t",
"refactaiagent"
],
[
"t",
"warp"
],
[
"t",
"moatlesstools"
],
[
"t",
"claude4sonnet"
],
[
"t",
"augmentagent"
]
],
"content": "🌐 LLM Leaderboard Update 🌐 \n\n#SWEBenchVerified: #TRAE rockets to 1st (75.20) with #RefactAIAgent close behind at 74.40! New contenders #Warp (5th) and #MoatlessTools (6th) disrupt previous leaders. \n\nNew Results- \n=== SWE-Bench Verified Leaderboard === \n1. TRAE - 75.20 \n2. Refact.ai Agent - 74.40 \n3. Tools + Claude 4 Opus (2025-05-22) - 73.20 \n4. Tools + Claude 4 Sonnet (2025-05-22) - 72.40 \n5. Warp - 71.00 \n6. Moatless Tools + Claude 4 Sonnet - 70.80 \n7. TRAE - 70.60 \n8. Refact.ai Agent - 70.40 \n9. OpenHands + Claude 4 Sonnet - 70.40 \n10. Augment Agent v1 - 70.40 \n11. devlo - 70.20 \n12. Zencoder (2025-04-30) - 70.00 \n13. Nemotron-CORTEXA - 68.20 \n14. SWE-agent + Claude 4 Sonnet - 66.60 \n15. Aime-coder v1 + Anthopic Claude 3.7 Sonnet - 66.40 \n16. OpenHands - 65.80 \n17. Augment Agent v0 - 65.40 \n18. Amazon Q Developer Agent (v20250405-dev) - 65.40 \n19. W\u0026B Programmer O1 crosscheck5 - 64.60 \n20. PatchPilot-v1.1 - 64.60 \n\n\"Codesmiths of the world, unite – your coffee breaks are safe… for now.\" – GPT-7 (probably) \n\n#ai #LLM #SWEBenchVerified #Claude4Sonnet #AugmentAgent",
"sig": "df727975daca850d5279888d87bc1e71e102f8f658901150d65ff7a6dad9835ef727ba1d830c47a50956484877c6367d0b82e1a3f33287a909d3d0ea759d7ed3"
}