cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

_sqldf not defined on Azure job cluster v12.2

piterpan
New Contributor III

Since yesterday we have errors in notebooks that were previously working.

 

 

NameError: name '_sqldf' is not defined

 

 

It was working previously.

We are on Azure databricks, usng job pool 
Driver: Standard_D4s_v5 · Workers: Standard_D4s_v5 · 1-6 workers · from pool · 12.2 LTS

We have opened a ticket on Azure, no response for now 😕 

1 ACCEPTED SOLUTION

Accepted Solutions

Tharun-Kumar
Honored Contributor II
Honored Contributor II

@piterpan 

This was a regression issue which impacted the jobs where _sqldf was referenced and the notebook those weren't run interactively. Our Engineering team has fixed this issue yesterday.

Could you check whether you are still facing the issue?

View solution in original post

8 REPLIES 8

Kale-S
New Contributor II

I have the same error since yesterday. 

I have rewrote all my magic SQL (%SQL) cells with the spark function:
query = """
              select * 
              from table
"""

df = spark.sql(query)

samirsaliba
New Contributor II

Same here, also on Azure Databricks. Cluster version is 12.2 LTS Photon.

ViniciusTavares
New Contributor II
Today I had the same error, the df _sqldf stopped working

aholts
New Contributor II

Having same issue since Thursday

whitebulb
New Contributor II

Same here. It was working completely fine a couple weeks ago.

Tharun-Kumar
Honored Contributor II
Honored Contributor II

@piterpan 

This was a regression issue which impacted the jobs where _sqldf was referenced and the notebook those weren't run interactively. Our Engineering team has fixed this issue yesterday.

Could you check whether you are still facing the issue?

Thank for your feedback.
We noticed it's working on v13.2 and we have been using v13.2 as a workaround.
I am waiting for the test on v12.2 and I'll confirm you if it's resolved for us.

piterpan
New Contributor III

I can confirm it's working again.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.