local filesystem access is forbidden
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-20-2024 10:36 PM
Hi,
When i running this command over my private cluster (Single User) it works well :
dbutils.fs.cp(ituff_file, protocol_local_file_path)
When i try to run it over a shared cluster, i am getting :
java.lang.SecurityException: Cannot use com.databricks.backend.daemon.driver.WorkspaceLocalFileSystem - local filesystem access is forbidden
Please advice!
Thanks1
Diagnose error
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-21-2024 11:03 PM
Hi, Could you please refer to the limitations here: https://docs.databricks.com/en/compute/access-mode-limitations.html#shared-access-mode-limitations-o... (Volumes do not support dbutils.fs commands distributed to executors.) , Also, for reference: https://docs.databricks.com/en/dev-tools/databricks-utils.html and https://community.databricks.com/t5/data-engineering/shared-cluster-configuration-that-permits-dbuti....
