topic databricks all-purpose cluster in Data Engineering

databricks all-purpose cluster

Ved88 — Wed, 07 Jan 2026 09:53:34 GMT

getting below error-Failure starting repl. Try detaching and re-attaching the notebook. while executing notebook and can see cluster have all installed lib.

Re: databricks all-purpose cluster

Ved88 — Wed, 07 Jan 2026 10:41:32 GMT

i can see metastore is down ,is that the reason notebook is not executing

Re: databricks all-purpose cluster

NandiniN — Thu, 08 Jan 2026 16:36:12 GMT

Hi @Ved88 ,

Usually this error occurs in case of library issues or conflict with versions. If you remove the libraries, do you still see the issue.

Additionally, review the driver logs to see if you see metastore related logs, which can give insights on what is the issue with the metastore.

Thanks!

Re: databricks all-purpose cluster

Ved88 — Fri, 09 Jan 2026 14:18:36 GMT

Hi ,

this issue might be related to hive metastore migration related.PFB

i can see driver log having this connection issue which matching the host in below url-IP CIDR For Azure Databricks Hive Metastore - Databricks Community - 133401

Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to address=(host=consolidated-westeuropec2-prod-metastore-0.mysql.database.azure.com)(port=3306)(type=master) : Socket fail to connect to host:consolidated-westeuropec2-prod-metastore-0.mysql.database.azure.com, port:3306. Connection refused

please share the steps to overcome this hive migration IP.

thanks!

Ved

Re: databricks all-purpose cluster

nayan_wylde — Fri, 09 Jan 2026 17:34:00 GMT

SQLNonTransientConnectionException with port 3306 strongly points to egress being blocked from your Databricks compute to the default Hive Metastore (which runs on Azure Database for MySQL). Databricks recently published the reserved IP ranges and guidance for allowlisting the metastore endpoints; if your firewall / UDRs still have the old IPs or only allow specific ranges, you’ll see exactly this error.

https://community.databricks.com/t5/product-platform-updates/ip-cidr-for-azure-databricks-hive-metastore/ba-p/133401

Re: databricks all-purpose cluster

Ved88 — Tue, 13 Jan 2026 08:23:36 GMT

Hi,

we are not using hive metastore anywhere not sure why that host ((host=consolidated-westeuropec2-prod-metastore-0.mysql.database.azure.com)(port=3306))is coming in driver log ,will i need to do whitelist for that .we are having other use case similar but not getting issue for others