cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

S3 Data access through unity

adrjuju
New Contributor II

Hey All I have the following issue : 

I've connected a s3 bucket through unity catalog as an external source. I perfectly see the files of my s3 bucket when i scroll through the catalog using the user interface. 

However when I try to connect through a notebook using this code : 

files = dbutils.fs.ls(LUMA_PATH)

I got the following error 


ExecutionError: An error occurred while calling o411.ls. : com.databricks.backend.daemon.data.common.InvalidMountException: Error while using path /Volumes/privatepath for creating file system within mount at '/Volumes/privatepath.

What is weird to me is that this exact command worked for some time after the creation of the cluster but it's not working anymore. 

Any ideas ? 

 

 

3 REPLIES 3

gchandra
Databricks Employee
Databricks Employee

What is the value of LUMA_PATH? is it /Volumes or s3:// 



~

adrjuju
New Contributor II

Hey Chandra thank you for your answer. 

The path is a volume path indeed, : /Volumes/my_path_in_volume

gchandra
Databricks Employee
Databricks Employee

This needs backend intervention to check what is blocking access to cloud files from the cluster. Could be Private Link. 

Please open a Support Ticket

https://help.databricks.com/s/



~

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group