cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

ADLSGen2: Cannot display Delta table summary from Data>Table tab on Databricks

steven_vcnt
New Contributor III

Hello, I have set up my account storage on Azure with an ADLSGen2 and I have succeeded to save the delta table on my ADLSGen2, from there I have created my delta table on Databricks.

From there I am unable to display the summary of my delta table under data>table tab as it shows the error below. Are we able to display the delta table summary within Databricks when the delta table comes from Azure?

Errorimage 

Thank you in advance,

Steven

1 ACCEPTED SOLUTION

Accepted Solutions

Hubert-Dudek
Esteemed Contributor III

Yes we are,

  • if you use private link please be sure that is set both for dfs and blob for ADLS
  • if you use app to mount Adls it have to use IAM role ""Storage Blob Data Contributor"
  • but problem can be with "I have succeeded to save the delta table on my ADLSGen2, from there I have created my delta table on Databricks" can you share your code how you saved delta files and created table from them?

View solution in original post

3 REPLIES 3

Hubert-Dudek
Esteemed Contributor III

Yes we are,

  • if you use private link please be sure that is set both for dfs and blob for ADLS
  • if you use app to mount Adls it have to use IAM role ""Storage Blob Data Contributor"
  • but problem can be with "I have succeeded to save the delta table on my ADLSGen2, from there I have created my delta table on Databricks" can you share your code how you saved delta files and created table from them?

Hey Hubert, thanks for your answer, I will check the 2 first points tomorrow. I have followed this documentation, the setup is about dfs and not blob, maybe it's the problem. For the third point, see below, I have removed my account info on purpose, I don't have any problem fetching data and/or describing history from my Delta Table through SQL queries:

image 

steven_vcnt
New Contributor III

Hello,

Following Hubert comment, in order to create a delta table on Databricks from Azure, I had to use CLONE argument in order to copy the data plus the metadata of my delta table on Azure. In order to set up the connection between Databricks and Azure, I have followed this documentation plus I have created an endpoint from my ADLSgen2 account storage to dfs databricks resources.

Best Regards,

Steven

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group