I am in the process of migrating our jobs from the legacy hive metastore to Unity. I have modified my existing job to read and write from a different bucket as part of the migration. The only change I have made to my job config is to enable this setting -
data_security_mode = "USER_ISOLATION"
As per my understanding this enables access to Unity Catalog on the cluster
I am running the latest DBR
But I keep getting this error, which I cannot understand and solve
Any help is appreciated!
Thanks in advance!
