cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Not able to setup external location via Catalog

nithin_1991
New Contributor III

Hi All,

 

I’m setting up an external location via Unity Catalog and I’m running into an issue when creating the location.

Context:

  • ADLS Gen2 account with Hierarchical Namespace is enabled.
  • A Databricks Access Connector has been created and assigned Contributor at both the subscription/resource and storage scopes.
  • As a sanity check, I tested legacy access using storage access keys and was able to connect successfully.

Given that the legacy method works but the UC path fails, I suspect the problem may be with the Unity Catalog configuration (e.g., storage credential/external location permissions).  I'm new to databricks so any advice would be great.

Thanks in advance for your guidance.

nithin_1991_0-1770842879242.png

 

nithin_1991_1-1770842966053.pngnithin_1991_2-1770842991733.png

4 ACCEPTED SOLUTIONS

Accepted Solutions

nithin_1991
New Contributor III

Hi All, Found the issue

It was related to path being called in url instead of using 

dfs.core.windows.net/ , I was using 
blob.core.windows.net/ which was throwing error

View solution in original post

joelramirezai
Databricks Employee
Databricks Employee

Hello @nithin_1991 
When you create a Databricks Azure Storage Account for Databricks, you always need to make sure that the hierarchical namespace is enabled.

Important considerations whren you create an external locations before you begin

View solution in original post

saurabh18cs
Honored Contributor III

Hi @nithin_1991 can you make sure it is storage blob data contributor granted to managed identity (dbac)

then create storage credential first for this dbac

saurabh18cs_1-1770910541012.png

then create external location using this credential

saurabh18cs_2-1770910628701.png

 

 

View solution in original post

Hi Joel ,

 

I had created with hierarchical namespace enabled only , issue was with url used which is now resolved but thanks for your input

nithin_1991_0-1770911090116.png

 

View solution in original post

6 REPLIES 6

nithin_1991
New Contributor III

Hi All, Found the issue

It was related to path being called in url instead of using 

dfs.core.windows.net/ , I was using 
blob.core.windows.net/ which was throwing error

joelramirezai
Databricks Employee
Databricks Employee

Hello @nithin_1991 
When you create a Databricks Azure Storage Account for Databricks, you always need to make sure that the hierarchical namespace is enabled.

Important considerations whren you create an external locations before you begin

Hi Joel ,

 

I had created with hierarchical namespace enabled only , issue was with url used which is now resolved but thanks for your input

nithin_1991_0-1770911090116.png

 

I have the following YouTube video that can guide you on how to properly create external locations: https://www.youtube.com/watch?v=cAXLFgcVMn0

Learn how to add External locations to unity catalog following the best practices

saurabh18cs
Honored Contributor III

Hi @nithin_1991 can you make sure it is storage blob data contributor granted to managed identity (dbac)

then create storage credential first for this dbac

saurabh18cs_1-1770910541012.png

then create external location using this credential

saurabh18cs_2-1770910628701.png

 

 

Yes, I did that and also provide storage blob owner access but issue was with url provided while setting up external location which is resolved now