topic Re: ADLSGen2: Cannot display Delta table summary from Data>Table tab on Databricks in Data Engineering

ADLSGen2: Cannot display Delta table summary from Data>Table tab on Databricks

steven_vcnt — Tue, 14 Dec 2021 18:01:54 GMT

Hello, I have set up my account storage on Azure with an ADLSGen2 and I have succeeded to save the delta table on my ADLSGen2, from there I have created my delta table on Databricks.

From there I am unable to display the summary of my delta table under data>table tab as it shows the error below. Are we able to display the delta table summary within Databricks when the delta table comes from Azure?

Thank you in advance,

Steven

Re: ADLSGen2: Cannot display Delta table summary from Data>Table tab on Databricks

Hubert-Dudek — Tue, 14 Dec 2021 19:17:29 GMT

Yes we are,

if you use private link please be sure that is set both for dfs and blob for ADLS
if you use app to mount Adls it have to use IAM role ""Storage Blob Data Contributor"
but problem can be with "I have succeeded to save the delta table on my ADLSGen2, from there I have created my delta table on Databricks" can you share your code how you saved delta files and created table from them?

Re: ADLSGen2: Cannot display Delta table summary from Data>Table tab on Databricks

steven_vcnt — Tue, 14 Dec 2021 20:44:36 GMT

Hey Hubert, thanks for your answer, I will check the 2 first points tomorrow. I have followed this documentation, the setup is about dfs and not blob, maybe it's the problem. For the third point, see below, I have removed my account info on purpose, I don't have any problem fetching data and/or describing history from my Delta Table through SQL queries:

Re: ADLSGen2: Cannot display Delta table summary from Data>Table tab on Databricks

steven_vcnt — Wed, 15 Dec 2021 09:08:37 GMT

Hello,

Following Hubert comment, in order to create a delta table on Databricks from Azure, I had to use CLONE argument in order to copy the data plus the metadata of my delta table on Azure. In order to set up the connection between Databricks and Azure, I have followed this documentation plus I have created an endpoint from my ADLSgen2 account storage to dfs databricks resources.

Best Regards,

Steven