Getting below error when trying to create a Data Quality Monitor for the table. ‘Cannot create Monit

Penguin_eye
New Contributor

Getting below error when trying to create a Data Quality Monitor for the table.

‘Cannot create Monitor because it exceeds the number of limit 500'.

nayan_wylde
Esteemed Contributor II

Databricks enforces a hard limit of 500 monitors per workspace to prevent excessive resource consumption.

 

Here are few options you can try out.

  • Identify monitors that are no longer needed and remove them.
  • Review your monitoring strategy and apply monitors only to high-value or critical tables.
  • If you truly need more than 500 monitors, you can open a support ticket with Databricks to request a quota increase.

View solution in original post

szymon_dybczak
Esteemed Contributor III

Hi @Penguin_eye ,

It seems like you're exceeding limit. What's weird - it says limit of 500. According to docs you can have 100 monitors per Metastore. So now I wonder from where this limit of 500 monitors is coming from.

szymon_dybczak_0-1764703560858.png

 

Hubert-Dudek
Databricks MVP

Maybe this is not a situation, but trial accounts have lower quotas. Tried to find the quota related to the monitor in "databricks resource-quotas list-quotas" but couldn't find it.

Your account contact in databricks can probably adjust it or find with you a way to configure it differently.


My blog: https://databrickster.medium.com/