Hi @jayct , @Gangster ,

The "Shared Compute" in Unity Catalog does not support the sparkContext as per the docs and is still the case with the latest version. We ended up using Personal Compute clusters for each of our developers and run the jobs under "Job Compute" in production.