12-14-2021 10:01 AM
Hello, I have set up my account storage on Azure with an ADLSGen2 and I have succeeded to save the delta table on my ADLSGen2, from there I have created my delta table on Databricks.
From there I am unable to display the summary of my delta table under data>table tab as it shows the error below. Are we able to display the delta table summary within Databricks when the delta table comes from Azure?
Thank you in advance,
Steven
12-14-2021 11:17 AM
Yes we are,
12-14-2021 11:17 AM
Yes we are,
12-14-2021 12:44 PM
Hey Hubert, thanks for your answer, I will check the 2 first points tomorrow. I have followed this documentation, the setup is about dfs and not blob, maybe it's the problem. For the third point, see below, I have removed my account info on purpose, I don't have any problem fetching data and/or describing history from my Delta Table through SQL queries:
12-15-2021 01:08 AM
Hello,
Following Hubert comment, in order to create a delta table on Databricks from Azure, I had to use CLONE argument in order to copy the data plus the metadata of my delta table on Azure. In order to set up the connection between Databricks and Azure, I have followed this documentation plus I have created an endpoint from my ADLSgen2 account storage to dfs databricks resources.
Best Regards,
Steven
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group