Databricks Community

Deepak_Kandpal · 09-27-2022

I have setup my Databricks notebook to use Service Principal to access ADLS using below configuration.service_credential = dbutils.secrets.get(scope="<scope>",key="<service-credential-key>") spark.conf.set("fs.azure.account.auth.type.<storage-accou...

Deepak_Kandpal · 09-13-2022

Hi All,I am trying to add new workflow which require to use credential passthrough, but when I am trying to create new Job Cluster from Workflow -> Jobs -> My Job, the option of Enable credential passthrough is not available. Is there any other way t...

Deepak_Kandpal · 09-27-2022

found the solution, need one additional configuration. spark._jsc.hadoopConfiguration().set("fs.azure.account.key.<account name>.dfs.core.windows.net",'<account key>')

Deepak_Kandpal · 09-13-2022

Hi Debayan,Thankyou for your response. I am working on a project where it require to read and process Excel file and I am using Maven Spark Excel library to read the excel file, and it is successfully reading on All purpose cluster with credential pa...

Databricks Community

User Stats

User Activity

Invalid configuration value detected for fs.azure.account.key with com.crealytics:spark-excel

Enable credential passthrough Option is not available in new UI for Job Cluster

Re: Invalid configuration value detected for fs.azure.account.key with com.crealytics:spark-excel

Re: Enable credential passthrough Option is not available in new UI for Job Cluster