Custom Catalog Not Visible to ADF and Looker in Databricks

[palearnings]

Hi Databricks community,

I’ve created a catalog called azure_data_factory and a database called studytube_azure_mysql_production. Within that database, I have three tables: academies, academy_naming_settings, and users.
See the left side of the screenshot.

However, when I try to connect Databricks to Azure Data Factory, ADF only displays the tables and the database studytube_azure_sql_production under the default catalog.
See the right side of the screenshot.

I’ve already granted the necessary permissions (USE and SELECT).

I’m experiencing the same issue when connecting Databricks to Looker — Looker can only see the tables and the database under the default catalog.

Ideally, I want all data replicated from ADF to be placed in schemas under the azure_data_factory catalog.
Has anyone encountered this issue?

[palearnings]

[szymon_dybczak]

Hi @palearnings ,

To query a table in Unity Catalog you need at minimum following privileges:

- USE CATALOG - on the parent catalog of the table

- USE SCHEMA - on the parent schema of the table

- SELECT on the table itself

Did you set all of those privileges on your ADF service principal?

If you did that then refer to following yt video. It shows how to setup adf dataset to point to specific UC table:

https://youtu.be/saVZdf6cQig?t=187

[Raman_Unifeye]

As mentioned by @szymon_dybczak, it is certainly a 'Grant' issue. Pls try granting the USE permissions to your SP first. Hope that resolves your issue.