Databricks Community

KJ_Saravana · 03-20-2023

HI,I have an init script which works on DBFS location during the cluster start up, but when the same shell script file is placed on ABFSS location (ADLS Gen 2 storage) I get the following init script failure error and the cluster is unable to start.E...

KJ_Saravana · 03-27-2023

Hi @Alex Ott thanks for helping us out. We were able to setup via UI on spark config and are able to start the cluster with the init scripts. spark.hadoop worked and in the config part we just replaced the ADLS clientID, Tenant ID and secret with th...

KJ_Saravana · 03-24-2023

Hi @Alex Ott Thanks a lot for that clarification. Now I understand that this could be done via a Terraform on cluster set up by providing the credentials like ADLS client id, tenant id and secret. Does that mean we can't set up the cluster using Dat...

Databricks Community

User Stats

User Activity

Databricks cluster Init scripts on ABFSS location

Re: Databricks cluster Init scripts on ABFSS location

Re: Databricks cluster Init scripts on ABFSS location