https://community.databricks.com/t5/administration-architecture/monitoring-jobs/m-p/23149#M120 <P>You could write code to call the <A href="https://docs.aws.amazon.com/AmazonCloudWatchLogs/latest/APIReference/API_PutLogEvents.html" alt="https://docs.aws.amazon.com/AmazonCloudWatchLogs/latest/APIReference/API_PutLogEvents.html" target="_blank">PutLogEvents</A> api at the beginning of each job to write out custom events to cloudwatch / or use aws sdk to send and SNS notification and route it to a desired consumer. </P><P></P><P></P> Wed, 23 Jun 2021 06:43:04 GMT sajith_appukutt 2021-06-23T06:43:04Z https://community.databricks.com/t5/administration-architecture/monitoring-jobs/m-p/23148#M119 <P>Are there any event streams that are or could be exposed in AWS (such as Cloudwatch Eventbridge events or SNS messages? In particular I'm interested in events that detail jobs being run.&nbsp;The use case here would be for monitoring jobs from our web application without needing to poll the jobs/list API endpoint.</P> <P>&nbsp;</P> Thu, 20 Mar 2025 16:30:54 GMT https://community.databricks.com/t5/administration-architecture/monitoring-jobs/m-p/23148#M119 Anonymous 2025-03-20T16:30:54Z https://community.databricks.com/t5/administration-architecture/monitoring-jobs/m-p/23149#M120 <P>You could write code to call the <A href="https://docs.aws.amazon.com/AmazonCloudWatchLogs/latest/APIReference/API_PutLogEvents.html" alt="https://docs.aws.amazon.com/AmazonCloudWatchLogs/latest/APIReference/API_PutLogEvents.html" target="_blank">PutLogEvents</A> api at the beginning of each job to write out custom events to cloudwatch / or use aws sdk to send and SNS notification and route it to a desired consumer. </P><P></P><P></P> Wed, 23 Jun 2021 06:43:04 GMT https://community.databricks.com/t5/administration-architecture/monitoring-jobs/m-p/23149#M120 sajith_appukutt 2021-06-23T06:43:04Z