Introducing Databricks Assistant Data Science Agent

[Sujitha]

Data Science Agent transforms Databricks Assistant into an autonomous partner for data science and analytics tasks in Notebooks and the SQL Editor. It can explore data, generate and run code, and fix errors, all from a single prompt. This can cut hours of work to minutes. Purpose-built for common data science tasks and grounded in Unity Catalog for seamless, governed access to your data. 

Since its launch two years ago, the Databricks Assistant has become an indispensable partner for data practitioners, helping them generate SQL and Python code, resolve errors, and receive contextual guidance directly within their workflows. Over that time, the AI landscape has advanced rapidly. The frontier has shifted from simple copilots and chatbots to agents that can reason, plan, and autonomously execute complex, multi-step processes.

Extending this paradigm to data requires more than fluency in code. Enterprise data agents must be aware of the context of your data, enable you to review and refine their work, and operate with the highest standards of governance. Databricks is uniquely positioned to deliver on this vision. With Unity Catalog providing unified policies, lineage, and business semantics, the platform is already the trusted foundation for data intelligence. Building on that foundation, agents can compress the time from question to insight without compromising on transparency, trust, or rigor. That is the future we are now bringing to the Databricks Assistant.

Continue to read more here.

[BS_THE_ANALYST]

@Sujitha this is really cool 👏. I watched the YouTube video on the Data Science Agent: https://www.youtube.com/watch?v=2Kz7Jcsu_nY&t=1s 

I like the interaction between the Agent and the User. The agent proposes a solution and the user gives the green light. 

I'm curious of future iterations with this where the human/user will be removed from the loop and another agent will take the human's place. We'll have one agent proposing and performing the task and another agent saying whether they agree with the strategy. Perhaps there's a toggle where we can flick between "full automation (agents only)" and "automation (human + agent)".

This new update is seriously cool, though. I've already been really impressed with the existing Databricks Assistant. Big shoutout to the product team 👏.

All the best,
BS