Unable to query Unity Catalog tables from notebooks.

animadurkar
New Contributor III

In my workspace, I'm able to see the unity catalogs my team has created. I'm able to see the schemas and even query data in there and create views using the SQL Editor.

When I go to write the same sql queries from a notebook using spark.sql or %sql I get this error:

AnalysisException: [UC_NOT_ENABLED] Unity Catalog is not enabled on this cluster.

I reviewed my cluster and it is a:

  • Databricks ML 13.0 Runtime
  • Access Mode is Single User
  • Personal Compute Policy

I'm unsure why this is the case, especially if I can access it normally outside of the notebook. Does anyone have ways to fix this?