If 2 users run the same notebook on the same cluster, will they share the same Spark session?

[fijoy]

Databricks docs here:

https://docs.databricks.com/notebooks/notebook-isolation.html

state that "Every notebook attached to a cluster has a pre-defined variable named spark that represents a SparkSession."

What if 2 users run the same notebook on the same cluster? Will they share the session? Or is the Spark session user-specific also in addition to cluster- & notebook-specific?

Thanks.

[Anonymous]

Hi @Fijoy Vadakkumpadan​ 

Great to meet you, and thanks for your question!

Let's see if your peers in the community have an answer to your question. Thanks.

[Lakshay · Accepted solution]

The spark session is isolated at the notebook level and is not isolated at the user level. So, two users accessing the same notebook will be using the same spark session

[fijoy]

Thanks @Lakshay Goel​ for the response. Follow up question: can the same notebook be attached to 2 different clusters at the same time by 2 different users?

[Lakshay]

No, we cannot attach the same notebook to 2 different clusters.