databricks_error_message:REQUEST_LIMIT_EXCEEDED:

[prashantjjain33]

A databricks job failed unexpectedly with below error. There ware only 5 jobs running at that time and no major operations. what could be the root cause and how can we avoid this in future

Cluster '0331-xxxxxx-zs8i8pcn' was terminated. Reason: INIT_SCRIPT_FAILURE (CLIENT_ERROR). Parameters: instance_id:i-097022eeexxxxx7, databricks_error_message:REQUEST_LIMIT_EXCEEDED: Your workspace(xxxxxxx10399) is sending too many requests..

[saurabh18cs]

are you generating any databricks tokens in this process? if yes there is a limit of 600.

[prashantjjain33]

Do you mean databricks PAT? No, we are not generating DBX PAT in this workflow

[saurabh18cs]

but this error indicates that your Databricks workspace is hitting API rate limits. (when there are too many API calls being made in a short period of time).

are you using multiple init scripts? can you Combine multiple init scripts into a single script to reduce the number of API calls during cluster startup.