Image
Real-SWE: even Claude Fable 5.1 fails 6 in 10 tasks on private code
Specific Labs' new Real-SWE benchmark drops coding agents into private enterprise repositories instead of public GitHub issues. The best model solves 38.8% of tasks — and how it fails explains why your agent struggles on your code.