I'm researching the different ways to debug in databricks notebooks and have some questions.
1. Can the python breakpoint() function be used in notebooks? This article says it can be used https://www.databricks.com/blog/new-debugging-features-databricks-notebooks-variable-explorer but this article says it cannot be used https://docs.databricks.com/aws/en/languages/python. The first is from 2023 so it may be outdated. I tried it and it did not appear to work at all since I expected the debugger toolbar to appear but it did not.
2. Is there a %debug magic command? I have found very little information on this in google but when I run that command in its own cell it seems to change the format of the cell and allows me to enter commands like continue and exit. If anyone knows about this command can you tell me if it is useful compared to the interactive debugger mentioned here https://docs.databricks.com/aws/en/notebooks/debugger?
3. Is the "best" all around debugging tool the interactive debugger mentioned here https://docs.databricks.com/aws/en/notebooks/debugger? I couldn't find much information on other tools other than connecting databricks to a separate IDE.
4. Does anyone recommend the pdb.set_trace() function from the pdb module? I am able to enter a debug mode when I include that function in a notebook cell but haven't used it much. Would appreciate any good resources.
Thank you!
