topic Re: Move files from DBFS to Workspace Folders databricks in Data Engineering

Move files from DBFS to Workspace Folders databricks

Abdurrahman — Wed, 22 Jan 2025 06:14:47 GMT

I want to move a zip file from DBFS to a workspace folder.

I am using dbutils.fs.cp("dbfs file path", "workspace folder path"), in databricks notebook and I am seeing the following error -

ExecutionError: An error occurred while calling o455.cp. : java.nio.file.AccessDeniedException initiate MultiPartUpload on REGION-prod/238....

What access do I require and how can I get them?

Re: Move files from DBFS to Workspace Folders databricks

Satyadeepak — Fri, 24 Jan 2025 19:12:45 GMT

@Abdurrahman The error message looks like a permission denied issue. Please ensure that you have the necessary permissions to read from the DBFS path and write to the workspace folder. You might need the following permissions:

Read access to the DBFS file path.
Write access to the target workspace folder.

Re: Move files from DBFS to Workspace Folders databricks

NandiniN — Sun, 26 Jan 2025 12:03:05 GMT

Kindly check your bucket policy. The error is for MultiPartUpload, you may want to check if the commit service is being blocked.

Re: Move files from DBFS to Workspace Folders databricks

nick533 — Sun, 26 Jan 2025 16:09:35 GMT

Permission denied appears to be the cause of the error message. To read from the DBFS path and write to the workspace folder, please make sure you have the required permissions. The following permissions may be required:

The DBFS file path can be read.
The target workspace folder can be written to.