Notebook Dashboard refreshes for all users when one user refreshes

[DR07]

Hi Team ,

I have created a dashboard using the dashboard functionality of the notebook.
But when one user refreshes the dashboard it refreshes for all the users with whom the dashboard is shared.
What are the ways this issue can be resolved ?

[nayan_wylde]

@DR07Assign each user their own cluster or use Single User cluster mode. This isolates execution state, but increases cost and management overhead.

https://docs.databricks.com/aws/en/compute/dedicated-overview

The 2nd option is using Databricks Sql dashboard. Advantages are: 

• Databricks SQL dashboards run queries independently for each user and don’t share the same notebook state.
• Each refresh is scoped to the user’s session, so no cross-user interference.

[DR07]

@nayan_wylde , thank you so much for responding
I'm using databricks api to fetch the data from databricks ui , which adds limitations to create Databricks SQL Dashboard.

[nayan_wylde]

@DR07 Can you please share more details and the API you are using? Are you using an API to trigger the notebook run?

[DR07]

@nayan_wylde 
I'm using the Databricks Jobs API endpoint to retrieve a list of job runs from my Databricks workspace in the notebook. I'm then using the fetched data for my visualization.

I have added multiple widgets to filter the data in the visualization and when one user is selecting a filter the dashboard refreshes for all users.

[nayan_wylde]

Got you. You can try to have dedicated cluster for users that ensures strong isolation. But it is not cost effective.

[DR07]

Got it , Thank you !