Getting driver error for my job when migrating to Unity
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-13-2026 01:31 AM
I am in the process of migrating our jobs from the legacy hive metastore to Unity. I have modified my existing job to read and write from a different bucket as part of the migration. The only change I have made to my job config is to enable this setting -
data_security_mode = "USER_ISOLATION"
As per my understanding this enables access to Unity Catalog on the cluster
I am running the latest DBR
I am running the latest DBR
But I keep getting this error, which I cannot understand and solve
Any help is appreciated!
Thanks in advance!
Any help is appreciated!
Thanks in advance!
Labels:
- Labels:
-
Spark
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-13-2026 05:16 AM
Quick correction here - I am using DBR 16.4 LTS (Scala 2.12, Spark 3.5.2)
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-19-2026 03:13 AM
Hi all!
Who can help me with this? A bit stuck here
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-19-2026 07:42 AM
You can validate using "SINGLE_USER"
