Databricks Community

Alex006 · 09-30-2023

Hi! Does DLT use one single SparkSession for all notebooks in a Delta Live Tables Pipeline?

Alex006 · 12-06-2022

I would like to publish data from from delta live table (DLT) to an Azure ADLS Gen2 storage. Checked the documentation but cannot get it to work. Any insights on how to do so?I've tried to specify the "Storage location" with many combinations of abfs...

Alex006 · 09-30-2022

Hi, Getting "Access validation failed" when trying to create a metastore. Anyone noticed anything extra needed to be done except for what's written in the azure guides below? Any help on how to succeed with creating a metastore would be deeply apprec...

Alex006 · 12-20-2022

Finally got it to work and here's what we did:Pre-conditions:Service Principal createdSecret created in Azure KeyVaultScope & Secret created in Databricks (Append "#secrets/createScope" in the url to get the databricks page where you create secrets)N...

Alex006 · 12-09-2022

Great, will try this. Thanks a lot!

Alex006 · 12-06-2022

I can use write and read from ADLS Gen2 using both the abfs and abfss protocol from regular notebooks. But for some reason it is not working for DLT. Do you know if there is a need to mount ADLS Gen2 to make it work specifically with DLT?

Alex006 · 12-06-2022

Hi! The problem has been resolved and the issue was a simple blank space that had found it's way into the ADLS Gen 2 absolute path. Thanks for the support!

Databricks Community

User Stats

User Activity

Does DLT use one single SparkSession?

Publish data to Azure ADLS Gen2 from Delta Live Tables pipelines?

Metastore creation - Azure Databricks - Access validation failed

Re: Publish data to Azure ADLS Gen2 from Delta Live Tables pipelines?

Re: Publish data to Azure ADLS Gen2 from Delta Live Tables pipelines?

Re: Publish data to Azure ADLS Gen2 from Delta Live Tables pipelines?

Re: Metastore creation - Azure Databricks - Access validation failed