Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
I think Overwatch is a good option which is provided by databricks lab , which creates a data modelling in top of all logs and then powerBI can be used for monitoring the metrics.