The Independent Analytics Agent Benchmark

Every configuration answers the same 300 questions (100 descriptive, 100 diagnostic, 100 prescriptive) against a deliberately messy simulated warehouse with withheld ground truth. No vendor can buy a position, or removal. How it is measured → Compare any two →

1C Snowflake Cortex Agents
claude-opus-4-8 logo claude-opus-4-8 · snowflake semantic view
83.7%99.7%100.0%$0.591
2hex logo Hex
gpt-5.6 (Hex) logo gpt-5.6 (Hex) · hex semantic model (dbt)
74.4%100.0%100.0%$0.352
3nao logo nao
claude-sonnet-5 logo claude-sonnet-5 · nao table docs
70.0%100.0%100.0%$0.953
4supersimple logo Supersimple
L LLM not disclosed · supersimple semantic model
69.7%98.3%100.0%–4
5G Databricks Genie
L LLM not disclosed · genie space instructions
65.7%68.0%80.0%–5
6cortex-analyst logo Snowflake Cortex Analyst
claude-sonnet-4-6 logo claude-sonnet-4-6 · snowflake semantic view
54.8%81.0%100.0%$0.136
7lightdash logo Lightdash AI
claude-sonnet-4-6 logo claude-sonnet-4-6 · lightdash semantic model
53.6%95.4%100.0%$0.317

Season 2026-S2 · question bank seed-v1 · universe seed 42 · judge claude-opus-4-8-r4.

Free audit

Find out what your agent got wrong last month.

Which agent are you running?

No database access needed.