cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Github workflow integration error

Philip_Budbee
New Contributor II

Hi,

We have a working Github integration in place for our production workspace which is running 14 different jobs that are scheduled during different intervals, but throughout the entire day.

The issue over the past 3-4 weeks that we have encountered is that consistently, once a week around the weekend, our jobs throw two different errors typically for 1-3 hours throwing these two errors:

Failed to checkout Git repository: PROJECTS_OPERATION_TIMEOUT: Timed out while performing operation. This may be due to a remote repo that is too large or a slow network. We do not recommend having more than 10000 notebooks in a repo.
Failed to checkout Git repository: PERMISSION_DENIED: Could not connect to git server. Make sure the git server is accessible from Databricks. Connecting to a private git server requires additional setup. Please contact your Databricks representative for details.

We can't really find anything about these errors online or in the forum here. We've tried to increase the cluster variable

spark.storage.blockManagerTimeoutIntervalMs

but it didn't solve the issue.

Note!

  1. Before and after the error period mentioned above everything works perfectly. It's for all our scheduled jobs under workflows.
  2. Our repository is fairly small so the size isn't the issue, and we have the correct permissions which is illustrated by the working state throughout the rest of the week.

Thanks for any help in solving our issue!

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group