cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

GCE cluster chokes the secret api server.

Sadam97
New Contributor III

Hi,

We upgraded the GKE cluster to GCE cluster as per the databricks documentation. It works fine with one or two notebooks in job. Our production job has more than 40 notebooks and each notebook access the secret api and seems like secret api server gets choke with GCE cluster. Same job was/is running on GKE cluster with no issue.

2 REPLIES 2

Alberto_Umana
Databricks Employee
Databricks Employee

Hi @Sadam97,

Could you please advise what is the error you are getting? 

Also the GKE version

Hi @Alberto_Umana ,

Error is on GCE and here is associated thread where i provided all info, https://community.databricks.com/t5/data-engineering/error-on-gce-job-cluster-after-upgrading-from-g...

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group