Allia
Databricks Employee
Databricks Employee

 @turagittech Please check the below article for possible methods to connect to Azure Data Lake Storage Gen2 and Blob Storage

https://docs.databricks.com/en/connect/storage/azure-storage.html#set-spark-properties-to-configure-...

To set Spark properties, use the following snippet in a cluster’s Spark configuration or a notebook:

spark.conf.set("fs.azure.account.auth.type.<storage-account>.dfs.core.windows.net", "SAS")

spark.conf.set("fs.azure.sas.token.provider.type.<storage-account>.dfs.core.windows.net", "org.apache.hadoop.fs.azurebfs.sas.FixedSASTokenProvider")

spark.conf.set("fs.azure.sas.fixed.token.<storage-account>.dfs.core.windows.net", dbutils.secrets.get(scope="<scope>", key="<sas-token-key>"))

Alliak