Hubert-Dudek
Databricks MVP

@Michael Galli​ , Yes, exactly mspnp/spark-monitoring library for Azure Monitor for that https://docs.microsoft.com/en-us/azure/architecture/databricks-monitoring/application-logs

I definitely prefer datadog https://www.datadoghq.com/blog/databricks-monitoring-datadog/. It is simple to integrate and more straightforward to visualize.


My blog: https://databrickster.medium.com/

View solution in original post