nayan_wylde
Esteemed Contributor II

@DR07Assign each user their own cluster or use Single User cluster mode. This isolates execution state, but increases cost and management overhead.

https://docs.databricks.com/aws/en/compute/dedicated-overview

The 2nd option is using Databricks Sql dashboard. Advantages are: 

  • Databricks SQL dashboards run queries independently for each user and don’t share the same notebook state.
  • Each refresh is scoped to the user’s session, so no cross-user interference.