cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Move files from DBFS to Workspace Folders databricks

Abdurrahman
New Contributor II

I want to move a zip file from DBFS to a workspace folder.

I am using dbutils.fs.cp("dbfs file path", "workspace folder path"), in databricks notebook and I am seeing the following error - 

ExecutionError: An error occurred while calling o455.cp. : java.nio.file.AccessDeniedException initiate MultiPartUpload on REGION-prod/238....

What access do I require and how can I get them?

3 REPLIES 3

Satyadeepak
Databricks Employee
Databricks Employee

@Abdurrahman The error message looks like a permission denied issue. Please ensure that you have the necessary permissions to read from the DBFS path and write to the workspace folder. You might need the following permissions:

  • Read access to the DBFS file path.
  • Write access to the target workspace folder.

NandiniN
Databricks Employee
Databricks Employee

Kindly check your bucket policy. The error is for MultiPartUpload, you may want to check if the commit service is being blocked.

Also read details here 

nick533
New Contributor II

Permission denied appears to be the cause of the error message. To read from the DBFS path and write to the workspace folder, please make sure you have the required permissions. The following permissions may be required:

The DBFS file path can be read.
The target workspace folder can be written to.

 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group