but this error indicates that your Databricks workspace is hitting API rate limits. (when there are too many API calls being made in a short period of time).

are you using multiple init scripts? can you Combine multiple init scripts into a single script to reduce the number of API calls during cluster startup.