Dear Community,I want to understand from you all - How do you debug your codes when using Databricks? Have you tried the Variable Explorer of Databr...

[Anonymous]

 

Dear Community,

I want to understand from you all - How do you debug your codes when using Databricks?

Have you tried the Variable Explorer of Databricks? This allows the users to view at-a-glance all the variables defined in their notebooks, inspect and explore DataFrames in one click, and interactively debug Python code with pdb.

Have you also Debugged your code and notebook by using Visual Studio Code?? Now there is a new feature added for interactive debugging and local Jupyter (ipynb) notebook development using this extension.

[-werners-]

I debug using notebooks.

As we develop in scala there is no other way.

[Anonymous]

Okay, good to know. Thats great that you are using scala.

[etsyal1e2r3]

I just create code in notebooks that allow me to check outputs at different steps. These methods usually include print statements or .display() of dataframes. If youre working with lots of data the .show(truncate=100,vertical=True) may help you. I have seen the variable view but that's never helped me more than programmatic methods and then clean up later. Its just faster that way. In addition, add comments and break up cell sections with markup cells using the %md magic command. Hope that helps!

[Anonymous]

Thats a wonderful suggestion that you provided to everyone in the Community.