Chainleft
@chainleft
SWE benchmarks have been destroyed in the last 1 year. March 2024, Devon, 14% December 2024, o1, 49% March 2025, Gemini 2.5 63% May 2025, Sonnet 4, 80% This is incredibly scary and exciting at the same time.
0 reply
0 recast
0 reaction
