StudioBench leaderboard

machine v4.1.0 · grade mode · 160 tasks · grades are 1–3 converted with development-set cut points; a missing cut counts as 0. Human column is shown as a reference only; ranking and scores come from the published machine board.

← process canvas

RankModelScore95% rank intervalSubmittedAUDSEMVISAVHuman scoreRated cellsHuman rank
1Claude Opus 5.592.221–315695.096.686.389.488.64771
2Gemini 4 Argon92.021–215995.497.683.888.986.62722
3GPT-6 Astra88.773–516093.797.672.787.086.44793
4DeepSeek V4.1 Flash88.343–515691.895.176.586.580.07626
5Doubao Seed 2.1 Pro86.874–616092.894.271.685.082.85794
6Qwen3.8 Max83.935–715287.092.569.683.080.89795
7Hy468.358–915849.290.176.645.463.80667
8MiMo v2.6 Pro63.358–912067.371.051.860.959.32788

Ranks are renumbered after omitting models excluded from this page; 95% intervals come from the original published board (paired bootstrap over tasks). AUD/SEM/VIS/AV are board means on the same 0–100 scale.