https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3193#M346 <P>Thats a wonderful suggestion that you provided to everyone in the Community.</P> Wed, 14 Jun 2023 08:00:31 GMT Anonymous 2023-06-14T08:00:31Z https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3189#M342 <P><span class="lia-inline-image-display-wrapper" image-alt="Discussions"><img src="https://community.databricks.com/t5/image/serverpage/image-id/73iF145002E3A875567/image-size/large?v=v2&amp;px=999" role="button" title="Discussions" alt="Discussions" /></span>&nbsp;</P><P>Dear Community,</P><P>I want to understand from you all - <B>How do you debug your codes when using Databricks?</B></P><P></P><P>Have you tried the <A href="https://www.databricks.com/blog/new-debugging-features-databricks-notebooks-variable-explorer?_gl=1*1fbcn4r*_gcl_aw*R0NMLjE2ODE5ODAxNTUuQ2owS0NRand4WU9pQmhDOUFSSXNBTmlFSWZhOEMwRGZPMmxKZ0FmWTl5UEJ6VHBFeFdmX2pMbHhVQ0stNkdkR2NyYjVPUkZqa08tb0hjUWFBdmI5RUFMd193Y0I.*_gcl_au*MTU3ODE0NTUxMC4xNjgxOTAxNzUy*_ga*MTA0MDgzNDQyMy4xNjgwNzc3Nzg3*_ga_PQSEQ3RZQC*MTY4NjY1ODcxMS4xOTQuMS4xNjg2NjU5ODMzLjYwLjAuMA..&amp;_ga=2.41454562.1741215643.1686526070-1040834423.1680777787" alt="https://www.databricks.com/blog/new-debugging-features-databricks-notebooks-variable-explorer?_gl=1*1fbcn4r*_gcl_aw*R0NMLjE2ODE5ODAxNTUuQ2owS0NRand4WU9pQmhDOUFSSXNBTmlFSWZhOEMwRGZPMmxKZ0FmWTl5UEJ6VHBFeFdmX2pMbHhVQ0stNkdkR2NyYjVPUkZqa08tb0hjUWFBdmI5RUFMd193Y0I.*_gcl_au*MTU3ODE0NTUxMC4xNjgxOTAxNzUy*_ga*MTA0MDgzNDQyMy4xNjgwNzc3Nzg3*_ga_PQSEQ3RZQC*MTY4NjY1ODcxMS4xOTQuMS4xNjg2NjU5ODMzLjYwLjAuMA..&amp;_ga=2.41454562.1741215643.1686526070-1040834423.1680777787" target="_blank">Variable Explorer </A> of Databricks? This allows the users to view at-a-glance all the variables defined in their notebooks, inspect and explore DataFrames in one click, and interactively debug Python code with&nbsp;<A href="https://docs.python.org/3/library/pdb.html" alt="https://docs.python.org/3/library/pdb.html" target="_blank"><I>pdb</I></A>.</P><P></P><P>Have you also Debugged your code and notebook by using <A href="https://www.databricks.com/blog/debug-your-code-and-notebooks-using-visual-studio-code" alt="https://www.databricks.com/blog/debug-your-code-and-notebooks-using-visual-studio-code" target="_blank">Visual Studio Code?</A>? Now there is a new feature added for&nbsp;interactive debugging&nbsp;and&nbsp;local Jupyter (ipynb) notebook development&nbsp;using this extension.</P><P></P> Tue, 13 Jun 2023 12:37:07 GMT https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3189#M342 Anonymous 2023-06-13T12:37:07Z https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3190#M343 <P>I debug using notebooks.</P><P>As we develop in scala there is no other way.</P> Tue, 13 Jun 2023 12:53:46 GMT https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3190#M343 -werners- 2023-06-13T12:53:46Z https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3191#M344 <P>I just create code in notebooks that allow me to check outputs at different steps. These methods usually include print statements or .display() of dataframes. If youre working with lots of data the .show(truncate=100,vertical=True) may help you. I have seen the variable view but that's never helped me more than programmatic methods and then clean up later. Its just faster that way. In addition, add comments and break up cell sections with markup cells using the %md magic command. Hope that helps!</P> Wed, 14 Jun 2023 02:18:17 GMT https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3191#M344 etsyal1e2r3 2023-06-14T02:18:17Z https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3192#M345 <P>Okay, good to know. Thats great that you are using scala.</P> Wed, 14 Jun 2023 07:59:43 GMT https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3192#M345 Anonymous 2023-06-14T07:59:43Z https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3193#M346 <P>Thats a wonderful suggestion that you provided to everyone in the Community.</P> Wed, 14 Jun 2023 08:00:31 GMT https://community.databricks.com/t5/data-engineering/dear-community-i-want-to-understand-from-you-all-how-do-you/m-p/3193#M346 Anonymous 2023-06-14T08:00:31Z