cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

UnknownHostException in Unity Catalog

ossinova
Contributor II

I have a few catalogs in databricks (using Unity Catalog). Each catalog (DEV, TEST, PROD) having its own external location (ADLSv2) and being tied to its own dbx workspace. Seeing how unity unifies the data, access policies and the metastore I would assume I could query data in PROD from DEV and vice versa.

However, I am getting this error when trying to do so:

-- in dev environment
USE CATALOG prod;
SELECT * FROM bronze.demo;

>> Error in SQL statement: ExecutionException: Status code: -1 error code: null error message: Cannot resolve hostname: xxxxPRODxxx.dfs.core.windows.net

java.net.UnknownHostException: xxxxPRODxxx.dfs.core.windows.net

4 REPLIES 4

karthik_p
Esteemed Contributor

@Oscar Dyremyhr​ It looks issue is not specific to unity catalog, but DNS resolution, can you try below steps from your unity catalog configured cluster by following below steps in article

UnknownHostException on cluster launch - Azure Databricks | Microsoft Learn

@karthik p​ The issue is not upon cluster launch, although it might be related. I am still able to access data from DEV. I will take a look.

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi @Oscar Dyremyhr​ , looking at the error it looks like it is not able to resolve the hostname, could you please try to nslookup the hostname and see if it is getting resolved? Also, what is used in your connection string? ("account" can be used)

@Debayan Mukherjee​ Thanks for the feedback. This solved my issue. Had to add some private endpoints to the underlying storage accounts in where the catalog was referencing data from.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!