topic Re: Notebook Dashboard refreshes for all users when one user refreshes in Data Engineering

Notebook Dashboard refreshes for all users when one user refreshes

DR07 — Wed, 17 Sep 2025 16:29:29 GMT

Hi Team ,

I have created a dashboard using the dashboard functionality of the notebook.
But when one user refreshes the dashboard it refreshes for all the users with whom the dashboard is shared.
What are the ways this issue can be resolved ?

Re: Notebook Dashboard refreshes for all users when one user refreshes

nayan_wylde — Wed, 17 Sep 2025 16:38:19 GMT

@DR07Assign each user their own cluster or use Single User cluster mode. This isolates execution state, but increases cost and management overhead.

https://docs.databricks.com/aws/en/compute/dedicated-overview

The 2nd option is using Databricks Sql dashboard. Advantages are:

Databricks SQL dashboards run queries independently for each user and don’t share the same notebook state.
Each refresh is scoped to the user’s session, so no cross-user interference.

Re: Notebook Dashboard refreshes for all users when one user refreshes

DR07 — Wed, 17 Sep 2025 16:48:57 GMT

@nayan_wylde , thank you so much for responding
I'm using databricks api to fetch the data from databricks ui , which adds limitations to create Databricks SQL Dashboard.

Re: Notebook Dashboard refreshes for all users when one user refreshes

nayan_wylde — Wed, 17 Sep 2025 16:54:13 GMT

@DR07 Can you please share more details and the API you are using? Are you using an API to trigger the notebook run?

Re: Notebook Dashboard refreshes for all users when one user refreshes

DR07 — Wed, 17 Sep 2025 17:05:38 GMT

@nayan_wylde
I'm using the Databricks Jobs API endpoint to retrieve a list of job runs from my Databricks workspace in the notebook. I'm then using the fetched data for my visualization.

I have added multiple widgets to filter the data in the visualization and when one user is selecting a filter the dashboard refreshes for all users.

Re: Notebook Dashboard refreshes for all users when one user refreshes

nayan_wylde — Wed, 17 Sep 2025 17:15:09 GMT

Got you. You can try to have dedicated cluster for users that ensures strong isolation. But it is not cost effective.

Re: Notebook Dashboard refreshes for all users when one user refreshes

DR07 — Wed, 17 Sep 2025 17:17:30 GMT

Got it , Thank you !