Cortex Agent

• ✓ evals: supported
• ✓ logs: supported
• ✓ cost: supported
• ✓ users: supported

Two Snowflake agents can be added to Benchouse. Cortex Analyst is set up with a view of its request log: see Cortex Analyst. This page is for Cortex Agents.

What Benchouse reads

• Questions, answers, reasoning and SQL from SNOWFLAKE.LOCAL.AI_OBSERVABILITY_EVENTS, and cost per request from CORTEX_AGENT_USAGE_HISTORY.
• Users from ACCOUNT_USAGE.USERS.

Connect

1. Create a role with access to the telemetry:

   CREATE ROLE benchouse_read;
   GRANT USAGE ON WAREHOUSE eval_wh TO ROLE benchouse_read;
   GRANT IMPORTED PRIVILEGES ON DATABASE SNOWFLAKE TO ROLE benchouse_read;
   GRANT DATABASE ROLE SNOWFLAKE.CORTEX_USER TO ROLE benchouse_read;
   GRANT DATABASE ROLE SNOWFLAKE.SECURITY_VIEWER TO ROLE benchouse_read;
   GRANT MONITOR ON AGENT my_db.my_schema.my_agent TO ROLE benchouse_read;

2. Create a service user with the role and a programmatic access token:

   CREATE USER benchouse_read TYPE = SERVICE_AGENT DEFAULT_ROLE = benchouse_read;
   GRANT ROLE benchouse_read TO USER benchouse_read;
   ALTER USER benchouse_read ADD PROGRAMMATIC ACCESS TOKEN benchouse_read ROLE_RESTRICTION = 'BENCHOUSE_READ';

3. In Agents, click Add agent, choose Cortex Agent, and create a Snowflake connection with the account identifier, warehouse, role and token.

4. Choose the agent from the ones the connection reports.