How to add 'additionallyAllowedTenants' in Databricks config or PySpark config?

[soumiknow]

I have a multi-tenant Azure app. I am using this app's credentials to read ADLS container files from Databricks cluster using PySpark dataframe.

I need to set this 'additionallyAllowedTenants' flag value to '*' or a specific tenant_id of the multi-tenant app in the databricks cluster config or PySpark session.

In Python I can achieve this by executing the below line of code:

default_credential = DefaultAzureCredential(additionally_allowed_tenants=['*'])

My query is, how can I achieve the same in Databricks config or PySpark session. Any leads are appreciated.

[soumiknow · Accepted solution]

Update: Currently spark does not have this feature.