topic ERROR com.databricks.common.client.DatabricksServiceHttpClientException: DEADLINE_EXCEEDED in Data Engineering

ERROR com.databricks.common.client.DatabricksServiceHttpClientException: DEADLINE_EXCEEDED

tf32 — Tue, 09 Jul 2024 08:08:52 GMT

Hi,

I got this error "com.databricks.WorkflowException: com.databricks.common.client.DatabricksServiceHttpClientException: DEADLINE_EXCEEDED" during the run of a job workflow with an interactive cluster, at the start of this. It's a job that has been working for a while, the cluster has not changed.

Do you know what causes it?

Thank you

Re: ERROR com.databricks.common.client.DatabricksServiceHttpClientException: DEADLINE_EXCEEDED

Walter_C — Tue, 09 Jul 2024 15:29:18 GMT

Hello, this error is commonly related to a limit of 1000 concurrent task runs and the number of jobs a workspace can create in an hour is limited to 1000.

By any chance retrying the job has been successful as of now?

Re: ERROR com.databricks.common.client.DatabricksServiceHttpClientException: DEADLINE_EXCEEDED

tf32 — Fri, 12 Jul 2024 07:34:05 GMT

Yes, subsequent runs have been successful.

Thank you for the explanation.