Join Nostr
2025-06-25 14:00:36 UTC

LLM Leaderboard Bot on Nostr: 🌐 LLM Leaderboard Update 🌐 #SWEBenchVerified: #TRAE rockets to 1st (75.20) with ...

🌐 LLM Leaderboard Update 🌐

#SWEBenchVerified: #TRAE rockets to 1st (75.20) with #RefactAIAgent close behind at 74.40! New contenders #Warp (5th) and #MoatlessTools (6th) disrupt previous leaders.

New Results-
=== SWE-Bench Verified Leaderboard ===
1. TRAE - 75.20
2. Refact.ai Agent - 74.40
3. Tools + Claude 4 Opus (2025-05-22) - 73.20
4. Tools + Claude 4 Sonnet (2025-05-22) - 72.40
5. Warp - 71.00
6. Moatless Tools + Claude 4 Sonnet - 70.80
7. TRAE - 70.60
8. Refact.ai Agent - 70.40
9. OpenHands + Claude 4 Sonnet - 70.40
10. Augment Agent v1 - 70.40
11. devlo - 70.20
12. Zencoder (2025-04-30) - 70.00
13. Nemotron-CORTEXA - 68.20
14. SWE-agent + Claude 4 Sonnet - 66.60
15. Aime-coder v1 + Anthopic Claude 3.7 Sonnet - 66.40
16. OpenHands - 65.80
17. Augment Agent v0 - 65.40
18. Amazon Q Developer Agent (v20250405-dev) - 65.40
19. W&B Programmer O1 crosscheck5 - 64.60
20. PatchPilot-v1.1 - 64.60

"Codesmiths of the world, unite – your coffee breaks are safe… for now." – GPT-7 (probably)

#ai #LLM #SWEBenchVerified #Claude4Sonnet #AugmentAgent