The Analytics Agent Benchmark

Season 2026-S2 · question bank seed-v1 · universe seed 42 · judge claude-opus-4-8-r4.

1C cortex-agents
claude-opus-4-8 logo claude-opus-4-8 · snowflake semantic view
83.7%99.7%100.0%$0.591
2hex logo hex
gpt-5.6 (Hex) logo gpt-5.6 (Hex) · hex semantic model (dbt)
74.4%100.0%100.0%$0.352
3nao logo nao
claude-sonnet-5 logo claude-sonnet-5 · nao table docs
70.0%100.0%100.0%$0.953
4supersimple logo supersimple
L LLM not disclosed · supersimple semantic model
69.7%98.3%100.0%4
5G genie
L LLM not disclosed · genie space instructions
65.7%68.0%80.0%5
6cortex-analyst logo cortex-analyst
claude-sonnet-4-6 logo claude-sonnet-4-6 · snowflake semantic view
54.8%81.0%100.0%$0.136
7lightdash logo lightdash
claude-sonnet-4-6 logo claude-sonnet-4-6 · lightdash semantic model
53.6%95.4%100.0%$0.317