Databricks Community

Yulei · 02-27-2024

Hi, Rencently, I am seeing issue Could not reach driver of cluster <some_id> with my structure streaming job when migrating to unity catalog and found this when checking the traceback:Traceback (most recent call last):File "/databricks/python_shell/...

Yulei · 01-28-2024

Hi, Databricks CommunityI am currently plan to do migrate of existing metastore (not in a desired account and name) to a new one (a different desired account) within the same region. I understand it is not as straightforward it might be and complicat...

Yulei · 03-05-2024

@Latonya86Dodson , Thank you for the reply. I have done a test, and it seems that double the memory of the driver cluster and change to use a instance with bigger memory works for this issue. However I do question why is this happen after I swap to p...

Yulei · 03-03-2024

Hi thank for the reply, Apologise, I am going through each of the suggestion to understand the fix, and also try to understand why this issue not showing before I implement the change to use single user cluster. Will provide more update once go throu...

Yulei · 02-11-2024

Hi, I am bumping this post since I am also encountering the same issue with shared cluster with apache sedona class when try to register and getting the following Py4JSecurityException error:py4j.security.Py4JSecurityException: Method public static v...

Yulei · 01-31-2024

hi, @Retired_mod . Thank for the recommendations and links, they are helpful and I am going through them one by one.

Databricks Community

User Stats

User Activity

Could not reach driver of cluster

Migrate existing Metastore to a new Metastore in same region

Re: Could not reach driver of cluster

Re: Could not reach driver of cluster

Re: Databricks Unity Catalog Shared Mode Cluster Py4J Security Issue

Re: Migrate existing Metastore to a new Metastore in same region