Hello,
I'm using Databricks Connect to connect a dash app to my Databricks account. My use case is similar to this example: https://github.com/databricks-demos/dbconnect-examples/tree/main/python/Plotly
I've been able to get everything configured and working properly with serverless compute. However I would like to be able to monitor how the dash app utilizes the serverless compute in real time. I'm aware of the ability to query the billing system table but would like to get more up to date information.
For example, with classic compute I am able to pull up the compute tab in the Databricks UI and easily see what is running, current dbus/hr, active memory, active cores, etc. Is there any way to see similar information for the serverless compute? Thanks!