BonuslyBench · Response Review Viewer v3

Every Model's Actual Answers — Question · Correct Answer · Model Answer

103 curated models × 40 GTM tests. Each test card shows the question asked, the correct answer (gold), and the model's full unedited answer — with per-check grading and telemetry.

📖 How to review: click any model name or the green view answers → button. On each model page, every test card shows three things: the question (top), the correct answer (gold panel, left) and the model's actual answer (white panel, right — click to expand). Models still completing the suite are shown in yellow-striped rows with their current partial score and test count.
⚖️ How grading works (explicitly): every response is graded by deterministic Python code (scorers.py) against frozen ground-truth files (truth_new.json / truth_canonical.json) that were computed programmatically from the same CSV data the models saw. NO LLM grades any response — no judge model, no AI evaluation, ever. Three check layers: (1) numeric presence within tolerance bands (e.g. ±5% for ratios, ±1–5% for money), (2) regex/phrase presence for required findings, (3) an entity whitelist that flags any deal/company alias not in the source data (fabrication detection). Every check shown as ✓/✗ chips is one of these deterministic checks. The identical code and identical truth files grade all 103 models — byte-for-byte the same standard. The full methodology is in the test specification.
#ModelMeanPerfectCost
1meta/muse-spark-1.1
view answers →
0.97735/40$2.17
2moonshotai/kimi-k3
view answers →
0.97636/40$7.67
3xiaomi/mimo-v2.5-pro
view answers →
0.97436/40$0.69
4meta/muse-spark-1.3
view answers →
0.97335/40$3.03
5z-ai/glm-5.3-flash
view answers →
0.96835/40$0.28
6tencent/hy3-preview
view answers →
0.96834/40$0.59
7z-ai/glm-5v-turbo
view answers →
0.967 · 36/40 final31/36$1.81
8anthropic/claude-opus-5
view answers →
0.96735/40$15.91
9tencent/hy3
view answers →
0.96736/40$0.33
10google/gemini-3.8-flash
view answers →
0.96634/40$6.34
11z-ai/glm-5-turbo
view answers →
0.966 · 31/40 final27/31$1.21
12qwen/qwen3.8-flash
view answers →
0.96534/40$0.34
13meta/muse-spark-1.2
view answers →
0.96433/40$3.60
14z-ai/glm-5.1
view answers →
0.96433/40$1.99
15qwen/qwen3.8-max-0902
view answers →
0.96234/40$3.88
16z-ai/glm-5.3
view answers →
0.96033/40$6.86
17deepseek/deepseek-v4-pro
view answers →
0.95933/40$1.04
18anthropic/claude-opus-4.5
view answers →
0.95732/40$9.83
19sakana/fugu-ultra
view answers →
0.95734/40$31.55
20openai/gpt-5.5-pro
view answers →
0.95632/40$123.62
21meituan/longcat-2.0
view answers →
0.95532/40$0.63
22anthropic/claude-opus-4.7
view answers →
0.95433/40$10.70
23google/gemini-3.7-flash
view answers →
0.95331/40$5.14
24moonshotai/kimi-k2.7-code
view answers →
0.95331/40$1.57
25qwen/qwen3.8-27b
view answers →
0.95332/40$1.63
26openai/gpt-5.2-pro
view answers →
0.95231/40$97.83
27openai/gpt-6-astra
view answers →
0.95234/40$19.82
28deepseek/deepseek-v4-pro-0813
view answers →
0.94732/40$1.85
29nex-agi/nex-n2-mini
view answers →
0.945 · 28/40 final23/28$0.06
30anthropic/claude-haiku-4.5
view answers →
0.94430/40$2.34
31openai/gpt-5.2
view answers →
0.94429/40$7.35
32qwen/qwen3.8-2.4t-a95b
view answers →
0.94331/40$5.20
33openai/gpt-5.6-luna-pro
view answers →
0.94331/40$1.04
34minimax/minimax-m2.1
view answers →
0.94231/40$0.67
35openai/gpt-5.4-pro
view answers →
0.94232/40$131.87
36openai/gpt-5.5
view answers →
0.94131/40$9.06
37openai/gpt-6-astra-pro
view answers →
0.94132/40$43.54
38openai/gpt-5.6-sol
view answers →
0.94029/40$3.67
39anthropic/claude-sonnet-5
view answers →
0.94032/40$8.38
40deepseek/deepseek-v4-flash-0731
view answers →
0.93930/40$0.09
41poolside/laguna-s-2.1
view answers →
0.939 · 39/40 final33/39$0.27
42anthropic/claude-opus-4.8
view answers →
0.93728/40$13.06
43openai/gpt-5.6-sol-pro
view answers →
0.93731/40$7.97
44openai/gpt-5.6-luna
view answers →
0.93630/40$0.42
45deepseek/deepseek-v4-flash
view answers →
0.93630/40$0.20
46openai/gpt-5.4-mini
view answers →
0.93530/40$3.21
47xiaomi/mimo-v2.5
view answers →
0.93230/40$0.27
48openai/gpt-5.1
view answers →
0.93130/40$4.83
49nex-agi/nex-n2-pro
view answers →
0.929 · 14/40 final10/14$0.05
50openai/gpt-5-pro
view answers →
0.92729/40$93.00
51meta/muse-glimmer-30b
view answers →
0.92530/40$0.98
52openai/gpt-5.4-nano
view answers →
0.92427/40$1.04
53stepfun/step-3.5-flash
view answers →
0.92329/40$0.45
54minimax/minimax-m2.5
view answers →
0.92328/40$0.44
55openai/gpt-5.6-terra
view answers →
0.92027/40$3.67
56inclusionai/ling-3.0-flash
view answers →
0.91928/40$0.06
57stepfun/step-3.7-flash
view answers →
0.91928/40$0.79
58openai/gpt-5
view answers →
0.91628/40$6.21
59thinkingmachines/inkling
view answers →
0.91627/40$3.13
60openai/gpt-5.6-terra-pro
view answers →
0.91526/40$7.98
61minimax/minimax-m2
view answers →
0.91428/40$1.19
62upstage/solar-pro4
view answers →
0.91329/40$0.05
63ibm-granite/granite-4.2-8b
view answers →
0.912 · 39/40 final24/39$0.36
64openai/gpt-chat-latest
view answers →
0.90829/40$3.77
65tencent/hy4-preview
view answers →
0.90629/40$1.73
66qwen/qwen3.7-flash
view answers →
0.90627/40$0.08
67openai/gpt-5-mini
view answers →
0.90531/40$1.04
68aion-labs/aion-3.0
view answers →
0.904 · 39/40 final32/39$3.54
69bytedance-seed/seed-2.0-mini
view answers →
0.90027/40$0.12
70google/gemma-4-31b-it
view answers →
0.89025/40$0.16
71bytedance-seed/seed-1.6
view answers →
0.88928/40$0.71
72minimax/minimax-m3
view answers →
0.87826/40$0.62
73aion-labs/aion-3.0-mini
view answers →
0.87428/40$1.29
74arcee-ai/trinity-large-thinking
view answers →
0.87326/40$0.68
75inception/mercury-2.5-preview
view answers →
0.86827/40$0.10
76deepseek/deepseek-v3.2
view answers →
0.86323/40$0.97
77google/gemini-3-pro-image
view answers →
0.86325/40$3.80
78poolside/laguna-xs-2.1
view answers →
0.85420/40$0.36
79aion-labs/aion-2.0
view answers →
0.85326/40$0.76
80thinkingmachines/inkling-small
view answers →
0.85123/40$0.89
81google/gemma-4-26b-a4b-it
view answers →
0.84520/40$0.11
82openai/gpt-5-nano
view answers →
0.79417/40$0.35
83mistralai/devstral-2512
view answers →
0.79116/40$0.69
84nvidia/nemotron-3.5-lightning
view answers →
0.78516/40$0.32
85inception/mercury-2
view answers →
0.78419/40$0.82
86openai/o4-mini
view answers →
0.77218/40$1.76
87mistralai/ministral-14b-2512
view answers →
0.75519/40$0.43
88inclusionai/ling-3.0-flash-fin
view answers →
0.74517/40$0.15
89mistralai/ministral-3b-2512
view answers →
0.74116/40$0.22
90mistralai/mistral-medium-3-5
view answers →
0.73815/40$1.49
91nvidia/nemotron-3-nano-30b-a3b
view answers →
0.72815/40$0.73
92openai/o3
view answers →
0.71517/40$4.13
93mistralai/mistral-small-2603
view answers →
0.71110/40$0.13
94meta-llama/llama-4-maverick
view answers →
0.69914/40$0.24
95amazon/nova-premier-v1
view answers →
0.69816/40$10.09
96meta-llama/llama-3.3-70b-instruct
view answers →
0.68316/40$0.05
97upstage/solar-pro-3
view answers →
0.64513/40$0.69
98amazon/nova-pro-v1
view answers →
0.6199/40$4.81
99ibm-granite/granite-4.0-h-micro
view answers →
0.1240/40$0.00
100minimax/minimax-m2-her
view answers →
0.1240/40$0.00
101thedrummer/cydonia-24b-v4.1
view answers →
0.1240/40$0.00
102kwaipilot/kat-coder-pro-v2
view answers →
0.1110/40$0.00
103kwaipilot/kat-coder-pro-v2.5
view answers →
0.1110/40$0.00