When developing locally, I can write %debug in a new cell after encountering an error, and jump into the function that the error originated from. In Databricks, this freezes the notebook indefinitely.

For example:

In [1]:

def query_data():

df_full = query("SELECT * FROM mytable")

df = df_full[df_full.mycolumn > 100]

assert not df.empty

return df

query_data()

Out [1]: AssertionError

In [2] %debug

(interactive prompt to explore df_full)

How do I get this functionality? I can get it in the Cloud Terminal, but that doesn't have the same python environment as my notebooks, so I can't really test things.