Akash_Varuna
New Contributor II

Hi @ShailenGenpact Could you check this post maybe this might help you 
https://community.databricks.com/t5/data-engineering/sparkcontext-in-runtime-15-3/td-p/81646
In this they have said similar case and some alternate workarounds they have used