Monitoring pool usage

nayan_wylde
Esteemed Contributor II

Hi All,

I am working on creating a dashboard for databricks instance pools. I am capturing maximum usage and scheduled a jpb to capture the info every 15 mins and I aggregate to see if any point the max usage is greater then 85% of capacity, Is there any other metrices that we can capture. Ideas are appreciated

nayan_wylde
Esteemed Contributor II

I am looking to build some custom metrices for pools. Some of them are available in dbdemos python package that refers system tables. I am looking to forecast my pool usage for next 30 days I am using ai_forecast function for it. Is there any other custom metrices we can capture for pools

View solution in original post

nayan_wylde
Esteemed Contributor II

The ai_forecast function did the magic and it have the forecast on pool usage that predicted for next 30 days