cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Getting below error when trying to create a Data Quality Monitor for the table. ‘Cannot create Monit

Penguin_eye
New Contributor

Getting below error when trying to create a Data Quality Monitor for the table.

‘Cannot create Monitor because it exceeds the number of limit 500'.

3 REPLIES 3

nayan_wylde
Esteemed Contributor

Databricks enforces a hard limit of 500 monitors per workspace to prevent excessive resource consumption.

 

Here are few options you can try out.

  • Identify monitors that are no longer needed and remove them.
  • Review your monitoring strategy and apply monitors only to high-value or critical tables.
  • If you truly need more than 500 monitors, you can open a support ticket with Databricks to request a quota increase.

szymon_dybczak
Esteemed Contributor III

Hi @Penguin_eye ,

It seems like you're exceeding limit. What's weird - it says limit of 500. According to docs you can have 100 monitors per Metastore. So now I wonder from where this limit of 500 monitors is coming from.

szymon_dybczak_0-1764703560858.png

 

Hubert-Dudek
Esteemed Contributor III

Maybe this is not a situation, but trial accounts have lower quotas. Tried to find the quota related to the monitor in "databricks resource-quotas list-quotas" but couldn't find it.

Your account contact in databricks can probably adjust it or find with you a way to configure it differently.