cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Generative AI
Explore discussions on generative artificial intelligence techniques and applications within the Databricks Community. Share ideas, challenges, and breakthroughs in this cutting-edge field.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Add Azure Databricks tables as knowledge source into Copilot Studio Agent

mcarreira
New Contributor

Hello!
Iโ€™m trying to add some tables from my Azure Databricks as a knowledge source in a Copilot Studio agent so that I can ask questions about the information stored in these tables.
The connection is created successfully, and I can see a preview of my tables in the Copilot agent. However, when I ask questions, the agent cannot access my data. How can I solve this issue?

1 REPLY 1

mark_ott
Databricks Employee
Databricks Employee

If your Azure Databricks tables show up as a knowledge source in Copilot Studio, but the agent cannot access data when you ask questions, the issue is often related to user or service account permissions, network rules, or the configuration of the table connection.

Troubleshooting Steps

  • Check that the user or service principal credentials used for the Copilot Studio connection actually have read access to the Databricks tables you want to query. Initial connection success does not guarantee all tables are accessible during a chat, especially if data retrieval is blocked by permissions or firewalls.โ€‹

  • Ensure there are no network security group (NSG) rules or Databricks workspace firewall settings preventing data retrieval during agent interaction. Sometimes you can preview data because the preview tool uses a different access method than Copilot Studio's query execution.โ€‹

  • Review the environmentโ€™s operation history or activity logs for details on errors. Switch from "Activity map" to "Transcript" to reveal hidden error messages such as token limit exceeded or authentication failures.โ€‹

  • Verify the Dataverse virtual table configuration if using virtual tables. Materialized views are required, not just views. Confirm a primary key exists for the tables, and the connector uses a compatible authentication method (service principal recommended).โ€‹

  • Check for errors or incomplete status messages in Copilot Studio, such as "SystemError" or "OpenAIMaxTokenLengthExceeded," which may require simplifying prompts or reducing input data size.โ€‹

  • Validate that Copilot Studio agent permissions and data access match expected requirements and that Microsoft 365 Copilot, if involved, is properly licensed and configured for enterprise data access.โ€‹

  • Revisit the Databricks connection in Copilot Studio, confirm credentials and permissions.

  • Test querying a very simple table or data set to see if the issue relates to prompt complexity or payload size.

  • Clean up the data structure passed to the agent to avoid exceeding token limits.

  • Consult the Microsoft 365 Service Health Dashboard for outages or service integration issues around the time of agent failures.โ€‹

  • If using Dataverse virtual tables, ensure you follow all required setup, such as primary keys and compatible authentication.โ€‹

By following these steps, you can usually identify and remedy why your Copilot Studio agent cannot access Databricks data even after seeing your tables in the preview.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now