Quickstart
Connect an agent and see its first conversations.
Updated 3 October 2026
1. Sign in
Sign in at app.benchouse.ai. Your organization is created the first time you sign in. Invite your team from the organization menu.
2. Add an agent
In Agents, click Add agent and choose what you want to measure. Then choose the connection it runs on, or create one: the login Benchouse uses to reach it. The next agent on the same account can reuse it. Each agent’s page lists the permissions it needs.
- Cortex Analyst: a Snowflake token, a view of the Analyst request log, and your semantic views.
- Cortex Agents: a Snowflake token.
- Databricks Genie: a Databricks personal access token.
- nao: a read-only role on nao’s own database.
- Custom agents: a connection string and a SQL query.
Click Test before you save. Adding an agent syncs it immediately and then every hour. Connections, the second tab, is where you rotate a token or set prices.
3. Review conversations
Logs lists every conversation with the question, answer, user and cost. Open an answer to see the agent’s reasoning, SQL and tool calls. Home shows completeness and accuracy, and Cost shows spend.
4. Run evals
Add a question set in Evals to grade the agent’s answers against expected results on a schedule. Set up Alerts to be notified when completeness or accuracy drops.