topic Re: Refresh the Spark UI automatically in Data Engineering

Refresh the Spark UI automatically

achistef — Fri, 05 Jan 2024 10:51:08 GMT

Hello!

I'm using Databricks with Azure. On a daily basis, I check the status of numerous jobs through the Spark UI. At the moment, the Spark UI does not refresh by itself. I have to refresh the webpage to get the latest status. I wonder if there is a way to enable automatic updates of the Spark UI. This would be very helpful!

I hope this is not a silly question,

Thank you for your time.

Re: Refresh the Spark UI automatically

shan_chandra — Thu, 11 Jan 2024 17:59:02 GMT

@achistef - This is a very good question. we at Databricks encourage users to be open with their questions.

There is an existing feature request to refresh the webpage . However, this needs to Since this is a new feature it will need to go through backlog prioritisation process which might take time.We don’t have an ETA on this at this point of time .However, you can always check the status of this feature in future by replying to this post or create a new one to know the status.

Thanks, Shan

Re: Refresh the Spark UI automatically

achistef — Thu, 11 Jan 2024 18:41:58 GMT

Thank you for the answer.

Re: Refresh the Spark UI automatically

shan_chandra — Thu, 11 Jan 2024 18:56:01 GMT

@achistef - you are welcome!!!