Databricks

deficiant_codge · 07-10-2023

Hi Everyone,I am trying to get spark context by running SparkSession builder command in a .py file and when i try to run it directl it works but if i got to a notebook and in a cell if i use %sh command to run python "myfilename" it gives an error th...

deficiant_codge · 07-05-2023

Hi All,Recently i created a custom docker image to run on databricks on cluster, Image built successfully and also cluster started but when i try to run anything in the notebook it's throwing error:File "/databricks/python_shell/scripts/db_ipyke...

deficiant_codge · 07-01-2023

Hi All, I recently have a use case where i need to run something on the databricks cluster and the bare requirement is that python version shoulde be 3.8 and DBR version should be 11+. I am confused on how to handle this. Is there anyway in which we ...

deficiant_codge · 11-06-2022

Is there any upcoming update in which UC will support DLT? if yes any expected ETA?

deficiant_codge · 10-19-2022

I cannot able to run following queriesALTER TABLE iot_events ADD ATTRIBUTE pii ON emailALTER TABLE users ADD ATTRIBUTE pii ON phoneGRANT SELECT ON DATABASE iot_data HAVING ATTRIBUTE NOT IN (pii) TO product_managersand GRANT SELECT ON iot_events TO ...

deficiant_codge · 07-10-2023

No Success 

deficiant_codge · 07-10-2023

I tried it also attached the image attached with the post, but it didn't worked

deficiant_codge · 07-10-2023

Actually i have some use case in which i have to mandatorily run the python file using %sh and in that i can't able to access those variables. I am aware of these variables but the problem is they just don't work.see the below images:

deficiant_codge · 07-03-2023

Hey Brice, Thanks for the response, but can you help me out on understanding how will i put this docker image on Databricks I am a very basic user and not much clear on that any blog or post will help,Thanks

deficiant_codge · 10-20-2022

@Kaniz Fatma even the support page is not working it's redirecting me again and again to the same page

Databricks

User Stats

User Activity

Not able to run spark context by running python file in a cell using %sh

Error 'ls_manager' can't be global while running a custom docker image

How to run a different python version then the default one on databricks cluster

Delta Live tables support for UNITY CATALOG

Can't able to run following queries

Re: Not able to run spark context by running python file in a cell using %sh

Re: Not able to run spark context by running python file in a cell using %sh

Re: Not able to run spark context by running python file in a cell using %sh

Re: How to run a different python version then the default one on databricks cluster

Re: Can't able to run following queries