- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-14-2021 10:01 AM
Hello, I have set up my account storage on Azure with an ADLSGen2 and I have succeeded to save the delta table on my ADLSGen2, from there I have created my delta table on Databricks.
From there I am unable to display the summary of my delta table under data>table tab as it shows the error below. Are we able to display the delta table summary within Databricks when the delta table comes from Azure?
Thank you in advance,
Steven
Accepted Solutions
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-14-2021 11:17 AM
Yes we are,
- if you use private link please be sure that is set both for dfs and blob for ADLS
- if you use app to mount Adls it have to use IAM role ""Storage Blob Data Contributor"
- but problem can be with "I have succeeded to save the delta table on my ADLSGen2, from there I have created my delta table on Databricks" can you share your code how you saved delta files and created table from them?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-14-2021 11:17 AM
Yes we are,
- if you use private link please be sure that is set both for dfs and blob for ADLS
- if you use app to mount Adls it have to use IAM role ""Storage Blob Data Contributor"
- but problem can be with "I have succeeded to save the delta table on my ADLSGen2, from there I have created my delta table on Databricks" can you share your code how you saved delta files and created table from them?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-14-2021 12:44 PM
Hey Hubert, thanks for your answer, I will check the 2 first points tomorrow. I have followed this documentation, the setup is about dfs and not blob, maybe it's the problem. For the third point, see below, I have removed my account info on purpose, I don't have any problem fetching data and/or describing history from my Delta Table through SQL queries:
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-15-2021 01:08 AM
Hello,
Following Hubert comment, in order to create a delta table on Databricks from Azure, I had to use CLONE argument in order to copy the data plus the metadata of my delta table on Azure. In order to set up the connection between Databricks and Azure, I have followed this documentation plus I have created an endpoint from my ADLSgen2 account storage to dfs databricks resources.
Best Regards,
Steven

