Per-test performance deltas against the base model. Green +X.XX = scored X.XX higher than the base on that test; red = lower; "=" = identical score. Click a model name for its full answers.
| Model | ceo slack compression | funnel digest paragraph | partner digest section | rfp answer from policy | stalled deal followup | churn save eligibility | expansion kit | onboarding status | renewal risk conflicting dates | ticket theme synthesis | crm completeness enrichment | gong hubspot join integrity | owner resolution | snowflake sql trapped catalog | stage hygiene audit | call transcript extraction | closed lost classification | next to close | pipeline tiering | product gap detection | case study match | channel attribution math | competitor battlecard update | nurture sequence diagnosis | weekly marketing goals rollup | datadog incident timeline | feature flag state summary | nda triage | runbook from slack thread | skill file reconciliation | activity mix vs outcome | ae qtd scorecard | multithreading gap | stale pipeline by rep | talk track from transcripts | aha moment 2x2 | arr rollforward reconciliation | kvm month over month | q3 weighted forecast | rewards ytd section |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| meta/muse-spark-1.1 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | +0.25 | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.17 | = | = | +0.40 | -0.20 | = | +0.50 |
| moonshotai/kimi-k3 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | = | +0.40 | = | = | +0.50 |
| xiaomi/mimo-v2.5-pro | = | = | = | = | = | = | = | = | = | +0.20 | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | -0.30 | +0.50 |
| meta/muse-spark-1.3 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | -0.25 | -0.17 | -0.20 | = | +0.40 | = | = | +0.50 |
| z-ai/glm-5.3-flash | = | = | = | = | = | = | = | = | = | +0.20 | = | +0.25 | = | = | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.17 |
| tencent/hy3-preview | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| z-ai/glm-5v-turbo | -0.20 | = | = | = | = | = | = | -0.25 | = | = | = | — | = | = | -0.33 | = | +0.40 | +0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | — | = | = | = | — | +0.20 | = | = | — |
| anthropic/claude-opus-5 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | -0.17 | = | +0.20 | -0.25 | = | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.40 | = | = | +0.50 |
| tencent/hy3 | = | = | = | = | = | = | = | = | = | +0.20 | = | -0.25 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.40 | = | = | +0.50 |
| google/gemini-3.8-flash | -0.20 | = | = | = | = | = | = | = | = | = | = | = | -0.33 | = | -0.17 | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.40 | = | = | +0.50 |
| z-ai/glm-5-turbo | = | = | = | = | = | = | = | = | = | = | = | — | — | = | — | = | +0.20 | +0.25 | — | = | = | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | — | — | = | — | = | — | = | = | = | — |
| qwen/qwen3.8-flash | = | = | = | = | -0.33 | = | = | = | = | = | = | = | -0.17 | = | = | = | +0.40 | +0.25 | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.20 | = | = | +0.50 |
| meta/muse-spark-1.2 | -0.20 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | = | +0.40 | +0.25 | = | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.40 | -0.20 | = | +0.50 |
| z-ai/glm-5.1 | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.33 | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.20 | = | -0.10 | +0.50 |
| qwen/qwen3.8-max-0902 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | -0.17 | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | = | = | = | = | +0.50 |
| z-ai/glm-5.3 | -0.20 | = | = | = | -0.33 | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | -0.10 | +0.50 |
| deepseek/deepseek-v4-pro | = | = | = | = | -0.33 | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | -0.17 | = | = | = | -0.33 | +0.20 | = | -0.20 | +0.50 |
| anthropic/claude-opus-4.5 | = | = | = | = | = | = | = | -0.25 | = | = | = | +0.25 | -0.17 | = | = | = | +0.40 | +0.25 | -0.20 | = | = | -0.20 | -0.20 | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| sakana/fugu-ultra | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.33 | = | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | -0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| openai/gpt-5.5-pro | = | = | = | = | = | = | = | = | = | = | -0.20 | +0.25 | -0.17 | = | = | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | -0.25 | -0.33 | = | = | +0.40 | = | = | +0.50 |
| meituan/longcat-2.0 | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | = | = | -0.17 | = | = | -0.10 | +0.50 |
| anthropic/claude-opus-4.7 | = | = | = | = | = | = | = | = | = | -0.20 | = | +0.25 | -0.17 | = | -0.17 | = | +0.20 | -0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | = | +0.20 | -0.20 | = | +0.50 |
| google/gemini-3.7-flash | -0.20 | = | = | = | = | = | = | = | = | = | = | = | -0.33 | = | = | = | +0.40 | = | = | = | = | = | -0.20 | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.40 | = | -0.10 | +0.50 |
| moonshotai/kimi-k2.7-code | = | = | = | = | = | = | = | = | = | +0.20 | = | = | -0.17 | = | = | = | +0.40 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | = | = | -0.17 | = | -0.20 | -0.10 | +0.50 |
| qwen/qwen3.8-27b | = | = | = | = | -0.33 | = | = | = | = | = | = | +0.25 | = | = | = | = | +0.20 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.33 | +0.20 | = | = | +0.50 |
| openai/gpt-5.2-pro | = | = | -0.33 | = | = | = | = | = | = | = | = | = | -0.17 | = | -0.17 | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | = | +0.40 | -0.20 | = | +0.33 |
| openai/gpt-6-astra | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.50 | = | = | +0.20 | -0.25 | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | = | +0.40 | = | = | +0.50 |
| deepseek/deepseek-v4-pro-0813 | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | -0.50 | = | = | +0.40 | = | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| nex-agi/nex-n2-mini | = | = | = | = | = | = | = | = | = | = | — | — | -0.67 | -0.33 | = | = | — | = | — | = | = | = | — | — | = | = | = | = | +0.25 | — | — | = | — | — | = | — | — | = | -0.10 | +0.50 |
| anthropic/claude-haiku-4.5 | = | = | = | = | = | = | -0.17 | = | = | = | = | +0.25 | -0.17 | = | = | = | +0.40 | +0.25 | -0.20 | = | = | = | = | = | = | = | = | = | = | = | = | = | -0.25 | -0.33 | = | -0.33 | +0.20 | = | = | +0.50 |
| openai/gpt-5.2 | -0.20 | = | -0.33 | = | = | = | = | = | = | = | = | = | -0.17 | = | -0.17 | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.17 | = | = | +0.40 | = | = | +0.33 |
| qwen/qwen3.8-2.4t-a95b | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | -0.33 | = | +0.40 | +0.25 | -0.20 | = | -0.25 | = | = | -0.25 | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | -0.33 | +0.40 | = | = | +0.50 |
| openai/gpt-5.6-luna-pro | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | -0.25 | -0.33 | = | = | +0.40 | = | = | = |
| minimax/minimax-m2.1 | -0.40 | = | = | = | = | = | -0.17 | = | = | +0.20 | = | +0.25 | = | = | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | -0.17 | = | = | = | -0.17 | +0.20 | = | = | = |
| openai/gpt-5.4-pro | = | = | -0.33 | = | = | = | = | = | = | = | = | +0.25 | -0.33 | = | = | = | +0.20 | -0.25 | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| openai/gpt-5.5 | = | = | = | = | = | = | = | = | = | = | -0.20 | +0.25 | -0.33 | -0.33 | -0.33 | = | +0.20 | +0.25 | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| openai/gpt-6-astra-pro | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.25 | = | -0.50 | = | = | +0.20 | -0.25 | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| anthropic/claude-sonnet-5 (BASE) | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.80 | 1.00 | 0.75 | 1.00 | 1.00 | 1.00 | 1.00 | 0.60 | 0.75 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.75 | 0.86 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.60 | 1.00 | 1.00 | 0.50 |
| openai/gpt-5.6-sol | -0.20 | = | = | = | = | = | = | -0.25 | = | = | -0.20 | +0.25 | = | -0.17 | = | = | +0.20 | = | -0.20 | = | = | = | = | = | = | = | = | = | = | = | = | = | = | -0.33 | = | = | +0.40 | = | = | +0.50 |
| deepseek/deepseek-v4-flash-0731 | = | = | = | = | -0.33 | = | = | = | = | = | = | = | = | = | -0.33 | = | +0.20 | = | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | = | = | = | = | = | = | -0.17 | +0.40 | = | -0.30 | +0.50 |
| poolside/laguna-s-2.1 | = | -0.67 | = | = | = | = | = | = | = | -0.20 | = | +0.25 | = | -0.33 | = | = | — | +0.25 | = | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | = | = | = | = | +0.50 |
| anthropic/claude-opus-4.8 | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | -0.33 | -0.17 | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.17 | = | -0.33 | +0.20 | = | -0.10 | +0.50 |
| openai/gpt-5.6-sol-pro | -0.20 | = | = | = | = | = | = | -0.25 | = | = | = | +0.25 | = | -0.33 | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.33 | = | = | +0.40 | = | = | = |
| openai/gpt-5.6-luna | = | = | = | = | = | = | = | -0.25 | = | = | -0.20 | +0.25 | -0.17 | -0.50 | = | = | +0.20 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | -0.25 | -0.33 | = | = | +0.40 | = | = | +0.50 |
| deepseek/deepseek-v4-flash | -0.40 | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | -0.17 | -0.20 | +0.40 | +0.25 | = | = | = | = | -0.20 | = | = | = | = | = | +0.25 | +0.14 | = | -0.17 | = | = | = | -0.17 | = | = | = | = |
| openai/gpt-5.4-mini | = | = | = | = | = | = | -0.17 | -0.25 | = | = | = | = | = | = | = | = | +0.20 | = | = | = | = | = | -0.20 | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.50 | = | -0.17 | = | = | = | +0.50 |
| xiaomi/mimo-v2.5 | = | = | = | = | = | = | = | = | = | = | = | = | -0.17 | = | -0.33 | = | +0.20 | = | = | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | = | = | = | = |
| openai/gpt-5.1 | = | = | -0.33 | = | = | = | -0.17 | = | = | -0.20 | = | = | -0.33 | = | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | -0.14 | = | = | = | -0.17 | = | -0.17 | +0.40 | = | -0.40 | +0.50 |
| nex-agi/nex-n2-pro | — | = | -0.33 | = | = | — | = | = | — | — | — | — | — | -0.17 | — | — | — | = | — | = | = | = | = | — | — | — | = | — | = | — | — | — | — | — | — | — | — | — | — | — |
| openai/gpt-5-pro | -0.20 | = | -0.33 | = | = | = | = | = | = | -0.20 | -0.20 | = | -0.33 | = | = | = | +0.40 | = | = | = | = | = | -0.20 | = | = | = | = | = | +0.25 | +0.14 | = | = | -0.25 | -0.33 | = | -0.17 | +0.40 | = | = | +0.50 |
| meta/muse-glimmer-30b | = | = | -0.33 | = | = | = | = | = | = | = | -0.20 | = | = | = | -0.17 | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | = | -0.17 | = | = | +0.40 | -0.20 | = | -0.50 |
| openai/gpt-5.4-nano | = | = | -0.33 | = | = | = | = | = | = | = | = | +0.25 | -0.17 | = | = | = | +0.40 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | -0.25 | -0.67 | = | -0.17 | +0.20 | -0.20 | -0.10 | +0.33 |
| stepfun/step-3.5-flash | = | = | = | = | = | -0.20 | = | = | -0.25 | +0.20 | = | +0.25 | -0.33 | = | = | = | +0.40 | = | = | = | = | = | = | = | -0.20 | = | = | = | +0.25 | = | = | = | -0.25 | -0.17 | = | -0.17 | +0.40 | = | -0.60 | = |
| minimax/minimax-m2.5 | -0.20 | = | = | = | = | -0.40 | -0.17 | = | -0.25 | = | = | = | -0.17 | -0.33 | = | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | = | = | -0.17 | +0.20 | = | = | = |
| openai/gpt-5.6-terra | -0.20 | = | -0.33 | = | = | -0.40 | = | = | = | = | -0.20 | +0.25 | -0.33 | -0.33 | = | = | +0.20 | = | -0.20 | = | = | = | -0.20 | = | = | = | = | = | +0.25 | +0.14 | -0.20 | = | = | -0.17 | = | = | +0.40 | = | = | +0.50 |
| inclusionai/ling-3.0-flash | = | -0.33 | -0.33 | = | = | -0.20 | -0.17 | = | = | = | = | +0.25 | = | = | = | = | +0.20 | = | = | = | = | = | -0.60 | = | = | -0.20 | = | = | +0.25 | = | = | = | = | = | = | = | = | -0.20 | = | +0.50 |
| stepfun/step-3.7-flash | = | = | -0.33 | = | = | = | = | -0.25 | = | = | = | -0.50 | -0.17 | = | = | = | +0.20 | +0.25 | = | = | = | = | = | -0.25 | = | = | = | = | +0.25 | = | = | -0.17 | = | = | = | -0.17 | = | -0.20 | = | +0.50 |
| openai/gpt-5 | -0.20 | = | -0.33 | = | = | = | = | = | = | = | -0.20 | = | -0.33 | = | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | -0.17 | +0.40 | = | -0.40 | = |
| thinkingmachines/inkling | = | = | = | = | -0.33 | = | = | = | -0.25 | = | = | -0.25 | -0.33 | = | = | -0.20 | +0.40 | = | -0.20 | = | = | -0.20 | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.17 | = | = | = | -0.20 | = | +0.50 |
| openai/gpt-5.6-terra-pro | -0.20 | = | -0.33 | = | = | = | = | -0.25 | = | = | -0.20 | +0.25 | -0.17 | -0.33 | = | = | +0.20 | = | = | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | -0.25 | -0.17 | = | = | +0.40 | = | -0.10 | = |
| minimax/minimax-m2 | -0.40 | = | = | = | = | = | = | = | = | = | = | -0.25 | = | -0.17 | = | = | +0.40 | = | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | -0.25 | -0.17 | = | -0.17 | +0.20 | = | -0.70 | +0.50 |
| upstage/solar-pro4 | -0.20 | = | = | = | = | = | -0.17 | = | = | = | = | +0.25 | = | = | -0.33 | = | +0.20 | +0.25 | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | -0.17 | = | -1.00 | = | = | +0.20 | = | -0.30 | = |
| ibm-granite/granite-4.2-8b | -0.20 | = | -0.33 | = | = | = | -0.17 | = | = | = | -0.20 | = | = | = | -0.17 | = | — | = | = | = | = | = | = | -0.25 | -0.20 | = | = | = | +0.25 | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.20 | -0.20 | -0.50 | +0.50 |
| openai/gpt-chat-latest | = | = | = | = | = | = | = | = | = | = | -0.20 | +0.25 | = | -0.50 | = | = | +0.20 | = | -0.40 | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | -0.75 | -0.33 | = | = | +0.40 | = | -0.10 | = |
| tencent/hy4-preview | = | = | = | = | -0.67 | = | = | = | = | = | -1.00 | = | = | -0.17 | = | = | +0.20 | = | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | = | = | = | = | -0.50 | = | -0.17 | +0.40 | = | = | +0.50 |
| qwen/qwen3.7-flash | = | = | -0.33 | = | = | -0.20 | -0.17 | = | = | -0.20 | = | = | -0.17 | = | = | = | +0.40 | = | = | = | = | = | -0.20 | = | = | -0.20 | = | = | +0.25 | +0.14 | = | -0.50 | = | = | = | = | +0.20 | = | -0.40 | = |
| openai/gpt-5-mini | = | = | -0.33 | = | = | = | = | = | = | = | = | -0.50 | = | = | -0.33 | = | +0.40 | = | = | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.67 | = | = | = | -0.20 | = | -0.17 |
| aion-labs/aion-3.0 | = | = | = | = | = | = | = | = | = | +0.20 | = | +0.25 | — | = | -1.00 | = | +0.20 | +0.25 | -0.80 | = | = | = | = | -1.00 | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.33 | = | = | +0.20 | -0.20 | = | +0.50 |
| bytedance-seed/seed-2.0-mini | = | = | -0.33 | = | -0.33 | = | -0.17 | = | = | = | = | = | -0.17 | = | -0.50 | = | +0.40 | +0.25 | = | -0.50 | = | = | = | = | -0.20 | = | = | = | +0.25 | +0.14 | = | = | = | -0.50 | = | -0.17 | +0.40 | = | -0.20 | = |
| google/gemma-4-31b-it | = | = | -0.33 | = | = | = | = | = | -0.25 | = | -0.20 | -0.25 | -0.83 | = | -0.17 | = | +0.40 | = | -0.20 | = | = | = | -0.20 | = | = | = | = | = | = | +0.14 | = | = | -0.25 | -0.17 | = | = | = | = | -0.20 | +0.50 |
| bytedance-seed/seed-1.6 | -0.20 | = | = | = | = | = | = | = | = | +0.20 | = | = | -0.33 | = | = | = | +0.20 | = | -0.80 | = | = | = | = | = | -0.20 | = | = | = | +0.25 | +0.14 | = | -0.50 | = | -0.33 | = | -0.67 | +0.40 | = | -0.20 | = |
| minimax/minimax-m3 | = | = | = | = | = | = | = | = | -0.25 | = | = | = | -0.67 | = | -1.00 | = | +0.40 | +0.25 | -0.20 | = | -0.25 | = | = | = | = | = | = | = | +0.25 | = | = | = | -0.25 | -0.17 | = | -1.00 | +0.20 | -0.20 | -0.10 | +0.50 |
| aion-labs/aion-3.0-mini | -0.40 | = | -0.33 | = | = | = | = | = | = | +0.20 | = | -0.75 | -0.33 | = | -0.33 | = | +0.20 | +0.25 | -0.20 | = | = | = | = | = | = | = | = | = | +0.25 | +0.14 | = | -0.17 | = | -0.50 | = | -0.67 | +0.40 | = | -0.40 | = |
| arcee-ai/trinity-large-thinking | -0.20 | = | = | = | -0.33 | = | = | = | = | -0.40 | = | = | -0.17 | = | -0.33 | = | +0.20 | = | = | = | = | = | = | = | -0.20 | = | = | = | +0.25 | +0.14 | = | -0.50 | = | = | = | -0.33 | = | -0.40 | -0.90 | +0.50 |
| inception/mercury-2.5-preview | = | = | = | = | = | = | -0.17 | = | -0.25 | -0.20 | = | = | -0.83 | = | -0.83 | = | +0.20 | +0.25 | = | = | = | -0.40 | = | = | = | = | = | = | +0.25 | +0.14 | = | = | = | -0.50 | = | -0.17 | +0.20 | = | -0.60 | = |
| deepseek/deepseek-v3.2 | -0.20 | = | = | = | = | -0.40 | = | = | -0.25 | -0.40 | = | -0.25 | -0.17 | = | -0.33 | = | +0.40 | -0.50 | = | -0.25 | -0.25 | -0.20 | = | -0.25 | = | -0.40 | = | = | +0.25 | = | = | -0.17 | -0.50 | = | = | = | +0.40 | = | -0.10 | +0.50 |
| google/gemini-3-pro-image | -0.20 | = | -0.33 | = | = | -0.20 | = | = | = | = | -0.20 | +0.25 | -0.17 | = | = | = | = | +0.25 | -0.20 | = | = | = | = | = | = | = | = | = | = | +0.14 | = | = | -0.25 | -0.33 | = | -0.83 | -0.60 | = | -0.40 | = |
| poolside/laguna-xs-2.1 | -0.20 | = | -0.33 | = | = | -0.20 | -0.17 | = | = | = | = | -0.25 | -0.33 | -0.17 | -0.17 | -0.40 | = | +0.25 | -0.20 | = | = | = | -0.20 | = | = | = | = | = | = | +0.14 | = | = | = | -0.17 | = | -0.17 | +0.20 | -0.40 | -0.70 | = |
| aion-labs/aion-2.0 | = | -0.67 | = | = | = | = | = | = | = | = | = | +0.25 | -0.67 | = | -1.00 | -0.20 | +0.20 | = | -0.20 | = | -0.25 | = | = | = | = | = | = | = | +0.25 | +0.14 | = | -0.17 | = | -1.00 | = | -0.17 | = | = | = | = |
| thinkingmachines/inkling-small | = | = | -0.33 | -0.25 | -0.33 | = | -0.33 | = | = | +0.20 | = | = | -0.33 | = | -0.17 | -0.20 | +0.20 | = | = | -0.50 | -0.75 | = | = | = | = | = | = | -1.00 | = | +0.14 | = | = | = | = | -0.20 | = | = | -0.20 | = | +0.50 |
| google/gemma-4-26b-a4b-it | = | = | -0.33 | = | = | -0.20 | = | = | -0.25 | = | -0.20 | -0.75 | -0.83 | = | -0.17 | = | +0.20 | = | -0.20 | -0.50 | = | = | -0.20 | = | = | = | = | = | = | +0.14 | = | = | -0.25 | -0.17 | = | = | +0.20 | -0.20 | -0.10 | = |
| openai/gpt-5-nano | = | = | -0.33 | = | = | -0.20 | -0.17 | = | = | -0.20 | = | -0.75 | -0.50 | = | -0.17 | = | +0.40 | = | -0.20 | -0.50 | -0.25 | = | -0.40 | = | -0.20 | = | = | -0.33 | +0.25 | +0.14 | = | -0.17 | -0.25 | -0.17 | -0.20 | -0.67 | = | -0.40 | -0.60 | = |
| mistralai/devstral-2512 | -0.40 | = | -0.33 | = | = | -0.60 | -0.17 | -0.25 | -0.25 | = | = | = | -0.67 | = | -0.33 | = | = | = | -0.20 | = | = | -0.20 | = | = | -0.20 | = | = | = | = | +0.14 | -0.80 | -0.17 | -0.25 | -0.50 | -0.40 | = | = | = | -0.40 | = |
| nvidia/nemotron-3.5-lightning | -0.20 | = | -0.33 | = | -0.33 | -0.60 | -0.17 | = | -0.25 | = | = | = | -0.67 | -0.33 | -0.50 | = | +0.20 | = | -0.20 | = | -0.25 | -1.00 | = | = | = | = | = | = | -0.25 | = | = | = | -0.25 | -0.17 | = | = | = | -0.40 | -0.50 | = |
| inception/mercury-2 | = | = | -0.33 | = | = | = | -0.50 | = | = | -0.40 | = | -0.25 | -0.67 | = | = | = | +0.20 | -0.50 | = | = | -0.25 | -0.20 | = | -0.25 | = | -0.20 | -0.25 | = | -0.25 | -0.43 | = | -0.67 | -0.25 | -0.17 | = | = | +0.20 | -0.20 | -0.70 | -0.17 |
| openai/o4-mini | -0.20 | = | -0.33 | = | = | -0.20 | -0.17 | = | -0.25 | -0.20 | = | -0.50 | -0.67 | = | = | = | +0.20 | +0.25 | -0.20 | -0.50 | = | = | -0.20 | -0.25 | -0.20 | = | = | = | = | +0.14 | = | -0.67 | = | -0.67 | = | -1.00 | -0.40 | -0.20 | -0.50 | = |
| mistralai/ministral-14b-2512 | -0.20 | = | -0.33 | = | = | -0.20 | -0.17 | = | -0.25 | = | = | -0.25 | -0.83 | = | -0.67 | = | = | = | -0.40 | -0.25 | = | -0.20 | = | = | = | = | = | = | +0.25 | -0.86 | = | -0.33 | = | -0.67 | = | -0.67 | -0.40 | = | -1.00 | = |
| inclusionai/ling-3.0-flash-fin | = | = | -0.33 | = | = | -0.20 | -0.17 | = | -0.50 | -0.20 | = | -0.50 | -0.83 | = | -0.17 | -0.40 | +0.40 | -0.25 | = | = | -0.25 | -0.60 | = | = | -0.20 | -0.20 | = | = | +0.25 | = | -0.40 | -0.17 | = | -0.67 | = | -0.83 | = | -0.80 | -0.80 | = |
| mistralai/ministral-3b-2512 | -0.20 | = | -0.33 | = | = | -0.40 | -0.67 | = | -0.50 | -0.20 | = | -0.25 | -0.33 | = | -0.17 | = | = | -0.25 | -0.40 | = | -0.25 | -0.20 | -0.20 | = | -0.20 | = | = | = | +0.25 | -0.86 | = | -0.33 | = | -0.83 | = | -0.33 | = | -0.40 | -0.90 | = |
| mistralai/mistral-medium-3-5 | -0.40 | = | -0.33 | = | = | -0.80 | = | -0.25 | = | -0.20 | -0.20 | -0.75 | -0.50 | = | = | = | +0.20 | = | = | -0.50 | = | -0.20 | = | = | -0.20 | = | = | = | -0.25 | = | -0.80 | -0.50 | -0.75 | -0.17 | -0.40 | -0.17 | +0.20 | -0.40 | -0.70 | = |
| nvidia/nemotron-3-nano-30b-a3b | = | = | -0.33 | = | = | -0.20 | -0.50 | = | -0.25 | -0.20 | = | -0.75 | -0.50 | = | -0.33 | = | = | -0.50 | = | -0.75 | -0.25 | -0.20 | -0.20 | -0.25 | -0.20 | -0.20 | = | = | +0.25 | +0.14 | = | = | -0.25 | -0.67 | -0.20 | -0.17 | -0.60 | -0.40 | -1.00 | = |
| openai/o3 | -0.20 | = | -0.33 | = | = | -0.40 | = | -0.25 | -0.25 | -0.20 | = | -0.75 | -0.83 | = | -1.00 | = | +0.20 | -0.25 | -0.80 | = | = | = | = | -0.25 | = | -0.20 | = | = | = | +0.14 | -0.80 | -0.50 | = | -0.67 | -0.20 | -0.17 | -0.40 | = | -0.40 | -0.50 |
| mistralai/mistral-small-2603 | -0.20 | = | -0.33 | = | = | -0.20 | -0.17 | -0.25 | -0.25 | -0.20 | = | = | -0.83 | -0.17 | -0.33 | = | = | = | -0.20 | -0.50 | -0.25 | -0.20 | -0.40 | = | = | = | = | = | = | = | -0.80 | -0.33 | -0.25 | -0.83 | -0.20 | -0.67 | -0.40 | -0.60 | -0.60 | = |
| meta-llama/llama-4-maverick | = | = | -0.33 | -1.00 | = | -0.20 | -0.17 | = | -0.25 | -0.20 | = | -0.75 | -0.67 | = | -0.33 | = | = | -0.25 | -0.20 | -0.75 | -0.25 | -0.20 | -0.20 | = | -0.20 | = | = | = | +0.25 | = | -0.20 | -0.83 | = | -1.00 | = | -0.67 | -0.40 | -0.20 | -0.50 | -0.17 |
| amazon/nova-premier-v1 | -0.20 | = | -1.00 | = | = | -0.80 | = | -0.25 | = | -0.20 | = | -0.75 | -0.33 | = | -0.67 | = | = | -0.25 | -0.20 | = | -0.75 | = | -0.20 | -0.25 | = | = | = | = | = | -0.29 | -0.20 | -0.50 | -0.25 | -0.67 | = | -0.83 | -0.40 | = | -0.70 | = |
| meta-llama/llama-3.3-70b-instruct | -0.20 | = | -0.33 | = | = | -0.40 | -0.33 | -0.50 | = | -0.60 | -0.20 | -0.75 | -0.33 | = | -0.67 | -0.80 | = | = | -0.80 | = | = | = | -0.40 | = | -0.20 | = | = | = | +0.25 | -0.86 | -0.60 | -0.50 | = | -1.00 | = | -0.17 | = | -0.40 | -1.00 | +0.50 |
| upstage/solar-pro-3 | -0.60 | -0.33 | -1.00 | = | = | -0.20 | -0.50 | = | -0.50 | -0.40 | = | -0.75 | -0.67 | = | -0.33 | = | +0.20 | -0.50 | -0.20 | -0.25 | -0.25 | = | = | -0.25 | = | -0.60 | = | = | -0.25 | -0.86 | -0.20 | -0.67 | -0.50 | -1.00 | = | -0.83 | +0.40 | -0.60 | -0.50 | +0.33 |
| amazon/nova-pro-v1 | = | = | -1.00 | = | = | -0.40 | -0.83 | -0.75 | -0.75 | -0.60 | -0.20 | -0.50 | -0.67 | -0.50 | -0.50 | -0.20 | +0.20 | -0.50 | -0.20 | -0.75 | -0.25 | -0.20 | -0.20 | = | -0.20 | = | = | = | -0.25 | +0.14 | -0.20 | -0.50 | -0.25 | -0.83 | -0.20 | -0.67 | +0.20 | -0.60 | -0.70 | = |
| ibm-granite/granite-4.0-h-micro | -0.40 | -0.67 | -1.00 | -1.00 | -0.33 | -1.00 | -0.83 | -1.00 | -1.00 | -0.80 | -1.00 | -0.75 | -0.83 | -0.50 | -1.00 | -0.80 | -0.60 | -0.50 | -0.80 | -1.00 | -0.50 | -1.00 | -1.00 | -1.00 | -1.00 | -1.00 | -0.75 | -0.83 | -0.75 | -0.86 | -0.80 | -1.00 | -1.00 | -1.00 | -0.60 | -1.00 | -0.60 | -0.80 | -1.00 | -0.33 |
| minimax/minimax-m2-her | -0.40 | -0.67 | -1.00 | -1.00 | -0.33 | -1.00 | -0.83 | -1.00 | -1.00 | -0.80 | -1.00 | -0.75 | -0.83 | -0.50 | -1.00 | -0.80 | -0.60 | -0.50 | -0.80 | -1.00 | -0.50 | -1.00 | -1.00 | -1.00 | -1.00 | -1.00 | -0.75 | -0.83 | -0.75 | -0.86 | -0.80 | -1.00 | -1.00 | -1.00 | -0.60 | -1.00 | -0.60 | -0.80 | -1.00 | -0.33 |
| thedrummer/cydonia-24b-v4.1 | -0.40 | -0.67 | -1.00 | -1.00 | -0.33 | -1.00 | -0.83 | -1.00 | -1.00 | -0.80 | -1.00 | -0.75 | -0.83 | -0.50 | -1.00 | -0.80 | -0.60 | -0.50 | -0.80 | -1.00 | -0.50 | -1.00 | -1.00 | -1.00 | -1.00 | -1.00 | -0.75 | -0.83 | -0.75 | -0.86 | -0.80 | -1.00 | -1.00 | -1.00 | -0.60 | -1.00 | -0.60 | -0.80 | -1.00 | -0.33 |
| kwaipilot/kat-coder-pro-v2.5 | -0.40 | -0.67 | -1.00 | -1.00 | -0.33 | -1.00 | -0.83 | -1.00 | -1.00 | -0.80 | -1.00 | -0.75 | -0.83 | -0.50 | -1.00 | -0.80 | -0.60 | -0.50 | -0.80 | -1.00 | -0.50 | -1.00 | -1.00 | -1.00 | -1.00 | -1.00 | -0.75 | -1.00 | -0.75 | -0.86 | -0.80 | -1.00 | -1.00 | -1.00 | -0.80 | -1.00 | -0.60 | -0.80 | -1.00 | -0.50 |
| kwaipilot/kat-coder-pro-v2 | -0.40 | -0.67 | -1.00 | -1.00 | -0.33 | -1.00 | -0.83 | -1.00 | -1.00 | -0.80 | -1.00 | -0.75 | -0.83 | -0.50 | -1.00 | -0.80 | -0.60 | -0.50 | -0.80 | -1.00 | -0.50 | -1.00 | -1.00 | -1.00 | -1.00 | -1.00 | -0.75 | -1.00 | -0.75 | -0.86 | -0.80 | -1.00 | -1.00 | -1.00 | -0.80 | -1.00 | -0.60 | -0.80 | -1.00 | -0.50 |