cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
PriyaV
by • New Contributor II
  • 13612 Views
  • 5 replies
  • 10 kudos

Suppress output in python notebooks

My dilemma is this - We use PySpark to connect to external data sources via jdbc from within databricks. Every time we issue a spark command, it spits out the connection options including the username, url and password which is not advisable. So, is ...

Data Engineering
Reply
  • 13612 Views
  • 5 replies
  • 10 kudos
View Replies
Latest Reply
Pabeggetur
New Contributor II
  • 10 kudos

Thanks for taking the time to discuss this, I feel strongly about it and love learning more on this topic.youi contact hoursuber eats complaints

  • 10 kudos
4 More Replies
Anonymous
by • Not applicable
  • 1029 Views
  • 1 replies
  • 0 kudos

Is there an equivalent of the %debug from Jupyter notebooks in Databricks notebooks for debugging python notebooks?

Is there an equivalent of the %debug from Jupyter notebooks in Databricks notebooks for debugging python notebooks?

Data Engineering
Reply
  • 1029 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Dileep_Vidyadar
New Contributor III
  • 0 kudos

Hi @Nathan Tong​ You can go through the 2 articles below that I found online for Debugging in Databricks.1. 7 Tips to Debug Apache Spark Code Faster with Databricks 2. Easier Spark Code Debugging

  • 0 kudos
Srikanth_Gupta_
by • Databricks Employee
  • 2871 Views
  • 2 replies
  • 0 kudos

Resolved! Can we use/import python notebooks in Scala notebooks and use any functions written in Python, vice versa as well?

Data Engineering
Reply
  • 2871 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
aladda
Databricks Employee
  • 0 kudos

Temp Views and Global Temp Views are the most common way of sharing data across languages within a Notebook/Cluster

  • 0 kudos
1 More Replies
Digan_Parikh
by • Valued Contributor
  • 1746 Views
  • 1 replies
  • 0 kudos

Resolved! Package cells for Python notebooks

Do we have an analogous concept to package cells for Python notebooks?

Data Engineering
Reply
  • 1746 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Digan_Parikh
Valued Contributor
  • 0 kudos

You can just declare your classes and in one cell, and use them in the others. It is recommended to get all your classes in one notebook, and use %run in the other to "import" those classes.The one thing you cannot do is to literally import a folder/...

  • 0 kudos
Labels