Capture events such as Start, Stop and Terminate of cluster.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-18-2023 07:58 AM
Hi,
I am using databricks with AWS.
I need to capture events such as Start, Stop and Terminate of cluster and perform some other action based on the events that happened on the cluster.
Is there a way I can achieve this in databricks?
Labels:
- Labels:
-
Aws databricks
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-18-2023 11:00 PM
@sonali totade
I see two ways of doing that:
- Creating a custom app that will monitor Clusters API (list and get) and store their status somewhere, then trigger an action on new or status change,
- Enable audit logging (https://docs.databricks.com/administration-guide/account-settings/audit-logs.html) and use CloudWatch or any other log analysis tool to create custom events.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-31-2023 01:06 AM