cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

UC Volume access for spark and other config files

dwfchu1
New Contributor II

Hi All,

Wondering if anyone else getting this problem:

We trying to host krb5.conf and jaas.conf for our compute to be able to connect to Kerberised JDBC sources, we attempting to store these files in Catalog volumes, but at run time when initiating the connection with spark.read.format("jdbc"), we get the following error:

"Cannot access the UC Volume path from this location. Path was...."

We using 14.2 (includes Apache Spark 3.5.0, Scala 2.12) runtime in Single User mode, which should be able to connect to UC volumes.

Example config we are using:

Djava.security.auth.login.config=dbfs:/Volumes/.../.../jaas.conf

We also checked that the single user also has ALL PRIVILEGES permissions on the catalog and subsequent schema/volumes

Also adding:

spark.databricks.unityCatalog.volumes.enabled true

Seems to make no difference ๐Ÿ˜ž

We have also tested that the connection works successfully with just having this in DBFS natively, but ideally we'd like to have better organisation and access-controlled of these files (keytab specifically) per catalog. Thanks!

1 REPLY 1

mbendana
New Contributor II

Haven't been able to access volume path when using jdbc format.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group