cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

UC Volume access for spark and other config files

dwfchu1
New Contributor II

Hi All,

Wondering if anyone else getting this problem:

We trying to host krb5.conf and jaas.conf for our compute to be able to connect to Kerberised JDBC sources, we attempting to store these files in Catalog volumes, but at run time when initiating the connection with spark.read.format("jdbc"), we get the following error:

"Cannot access the UC Volume path from this location. Path was...."

We using 14.2 (includes Apache Spark 3.5.0, Scala 2.12) runtime in Single User mode, which should be able to connect to UC volumes.

Example config we are using:

Djava.security.auth.login.config=dbfs:/Volumes/.../.../jaas.conf

We also checked that the single user also has ALL PRIVILEGES permissions on the catalog and subsequent schema/volumes

Also adding:

spark.databricks.unityCatalog.volumes.enabled true

Seems to make no difference 😞

We have also tested that the connection works successfully with just having this in DBFS natively, but ideally we'd like to have better organisation and access-controlled of these files (keytab specifically) per catalog. Thanks!

1 REPLY 1

mbendana
New Contributor II

Haven't been able to access volume path when using jdbc format.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!