Hi Valskyyy,

I tried to do the same steps at my end. But it works fine for me even if I try to do Run All. My guess is that there is some other issue happening at the cluster which resets the cluster and hence, the temporary view definition is getting dropped as temporary view are tied to a sparksession.

Could you try putting just the four steps you mentioned in a separate notebook and see if the issue reoproduces then?

Also, could you try creating the view using "df.createOrReplaceTempView" method to check if the issue with sql implementation only?