cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Administration & Architecture
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Setup Alerts to monitor cost in dartabricks

Francis
New Contributor II

Hi Team Tech,

Recently we had an huge bill in databricks and we want to somehow have an alerting system in place to monitor cost.

Please can someone help me to know how to setup email notification for cost alerts in databricks.

As we need to setup an email alert if the cost reaches more that whats mentioned in the alert.

Also can someone help to access BudgetAPI. how do I access Budget API and how can i setup email alerts to email me when cost goes high than the expected budget.

 

Francis Lobo

3 REPLIES 3

bollids2
New Contributor II

In the Databricks workspace, navigate to the "Admin Console" and select "Cost Management." Set up budgets with thresholds that trigger alerts. Specify the email addresses where you want to receive notifications. Databricks doesn't directly support sending emails, so you'll need to use an external service. Python's smtplib library can be used for this purpose. Write a Python script to connect to the SMTP server and send alert emails. You can use Databricks notebooks for this. Schedule the script to run at regular intervals using Databricks' Job Scheduler or an external scheduler like Apache Airflow. Ensure the script is configured to run with the necessary permissions to access Databricks API and send emails.

 

 

 

PaybyPlateMa

Francis
New Contributor II

Hi 

Thanks for your reply.

I checked in the Databricks workspace, navigating to the "Admin Console but I could not find Cost Management option.

Please let me know if Iam missing something. Attached the screengrab.

Francis

karthik_p
Esteemed Contributor

@Francis looks Budget API is not available now, one thing you can do is setting alerts in cloud level or create custom scripts to pull DBU price from billable API https://docs.databricks.com/api/account/billableusage/download and try to trigger email alert using custom code