Most widely cited AI coding benchmarks, including the original SWE-bench, were built primarily around Python repositories, meaning headline performance results may not accurately predict how coding ag ...
There was an error while loading. Please reload this page.
Compendium of over 50 benchmarks for evaluating AI agents, categorized into Function Calling & Tool Use, General Assistant & Reasoning, Coding & Software Engineering, and Computer Interaction. - ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results