cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks notebook Issue

DataGuy2
Visitor

Hello Databricks Community,

I’m facing multiple issues while working in Azure Databricks notebooks, and I’d appreciate guidance or troubleshooting suggestions.

Issue 1: Failed to reconnect

While running a notebook, I frequently see a “Failed to reconnect” message in the UI.

Error details:

org.apache.http.conn.HttpHostConnectException: Connect to westus.azuredatabricks.net:443 [10.115.69.106] failed: Connection timed out (Connection timed out)

This causes the notebook to stay in a Waiting state and prevents execution.

Issue 2: Network connection timeout

The error suggests a timeout while connecting to the Databricks control plane (westus.azuredatabricks.net:443).
This occurs intermittently and impacts productivity.

Issue 3: Notebooks taking longer than expected to run

Even when the notebook starts successfully:

  • Jobs take significantly longer than expected

  • Some cells remain in Waiting state for a long time

  • Performance degradation is noticeable compared to earlier runs

    Environment details:

    • Azure Databricks (Region: West US)

    • Notebook language: Python (PySpark)

    • Workload includes reading/transformation and writing data to Snowflake

    • Issue observed across multiple notebooks

0 REPLIES 0