cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

Python Code not working in DBR 10.4 LTS - Shared Mode

parthsalvi
Contributor

Hello,

We're trying to use DBR 10.4 LTS in Shared Mode.

But our python code is not working in that cluster.

We're running into following message

Your administrator has only allowed sql commands on this cluster. This execution contained at least one disallowed languageimage 

As suggested, we also tried setting spark conf "spark.databricks.repl.allowedLanguages"

in cluster but still we get same message.

In Admin login both workspace and account level we're not able to locate any such option of setting language.

Note: We've a customer managed VPC installation and using Unity Catalog as well.

Python code is working in No isolation mode but we cannot use it as it doesn't support unity catalog.

Is this bug or a set up issue?

1 ACCEPTED SOLUTION

Accepted Solutions

Cedric
Valued Contributor
Valued Contributor

Hey @Parth Salvi​,

Got it, could you please try adding the following Spark config to your cluster running DBR 10.4?

spark.databricks.unityCatalog.userIsolation.python.preview true

View solution in original post

4 REPLIES 4

Cedric
Valued Contributor
Valued Contributor

Hi Parthsalvi,

Could you please try using 11.1+ and see if that works?

Yes it does work on 11.1+ . But we're running into few issues on 11.2

like these Screenshot 2022-09-16 at 9.09.58 PM So we wanted to fix the issue in 10.4 itself. Is this a known issue ?

Cedric
Valued Contributor
Valued Contributor

Hey @Parth Salvi​,

Got it, could you please try adding the following Spark config to your cluster running DBR 10.4?

spark.databricks.unityCatalog.userIsolation.python.preview true

Python code now working on 10.4 LTS shared mode. Thanks a lot, Cedric !!!

But still facing same issues in 10.4 as well. I've added a separate post for it

https://community.databricks.com/s/question/0D58Y00009DDRguSAH/few-sparks-apis-not-working-in-dbr-11...

Does it seem like custom vpc set up issue ?

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!