https://community.databricks.com/t5/machine-learning/medium-datadriveninvestor-com/m-p/23101#M1305 <P>say, I want to download 2 files from this directory (dbfs:/databricks-datasets/abc-quality/") to my local filesystem, how do I do it?</P><P></P><P>I understand that if those files are inside FileStore directory, it is much straightforward, which someone posts some solution here:</P><P></P><P><A href="https://medium.datadriveninvestor.com/how-to-download-a-file-from-databricks-filestore-to-a-local-machine-ae0c40f164f5" target="test_blank">https://medium.datadriveninvestor.com/how-to-download-a-file-from-databricks-filestore-to-a-local-machine-ae0c40f164f5</A></P><P></P><P>Hence, now I am trying to see if it is possible to do a copy files from directory dbfs:/databricks-datasets/abc-quality/</P><P></P><P>to</P><P></P><P>directory in FileStore, which I tried below:</P><P></P><P>dbutils.fs.cp ("dbfs:/FileStore/", "dbfs:/databricks-datasets/abc-quality/", recurse = True)</P><P></P><P>but gives me error message:</P><P></P><P>java.rmi.RemoteException: com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied; request: PUT <A href="https://databricks-datasets-oregon.s3.us-west-2.amazonaws.com" target="test_blank">https://databricks-datasets-oregon.s3.us-west-2.amazonaws.com</A> quality/Bonus_jan.csv {} aws-sdk-java/1.12.101 Linux/5.4.0-1088-aws OpenJDK_64-Bit_Server_VM/25.342-b07 java/1.8.0_342 scala/2.12.14 kotlin/1.4.0 vendor/Private_Build cfg/retry-mode/legacy com.amazonaws.services.s3.transfer.TransferManager/1.12.101 com.amazonaws.services.s3.model.PutObjectRequest; Request ID: JN9487JSJFXDPAY8, Extended Request ID: zkWIIgPXRte6UWeXv5BzC/IzHXhqOntjdCyGiBw34+mm3qMi1irFm9jfY3/iwEfbt/0Ywz4TsKw=, Cloud Provider: AWS, Instance ID: i-0f553097120e72dd4 (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: JN9487JSJFXDPAY8; S3 Extended Request ID: zkWIIgPXRte6UWeXv5BzC/IzHXhqOntjdCyGiBw34+mm3qMi1irFm9jfY3/iwEfbt/0Ywz4TsKw=; Proxy: null), S3 Extended Request ID: zkWIIgPXRte6UWeXv5BzC/IzHXhqOntjdCyGiBw34+mm3qMi1irFm9jfY3/iwEfbt/0Ywz4TsKw=; nested exception is:</P><P></P><P></P><P></P> Wed, 09 Nov 2022 08:59:34 GMT THIAM_HUATTAN 2022-11-09T08:59:34Z https://community.databricks.com/t5/machine-learning/medium-datadriveninvestor-com/m-p/23101#M1305 <P>say, I want to download 2 files from this directory (dbfs:/databricks-datasets/abc-quality/") to my local filesystem, how do I do it?</P><P></P><P>I understand that if those files are inside FileStore directory, it is much straightforward, which someone posts some solution here:</P><P></P><P><A href="https://medium.datadriveninvestor.com/how-to-download-a-file-from-databricks-filestore-to-a-local-machine-ae0c40f164f5" target="test_blank">https://medium.datadriveninvestor.com/how-to-download-a-file-from-databricks-filestore-to-a-local-machine-ae0c40f164f5</A></P><P></P><P>Hence, now I am trying to see if it is possible to do a copy files from directory dbfs:/databricks-datasets/abc-quality/</P><P></P><P>to</P><P></P><P>directory in FileStore, which I tried below:</P><P></P><P>dbutils.fs.cp ("dbfs:/FileStore/", "dbfs:/databricks-datasets/abc-quality/", recurse = True)</P><P></P><P>but gives me error message:</P><P></P><P>java.rmi.RemoteException: com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied; request: PUT <A href="https://databricks-datasets-oregon.s3.us-west-2.amazonaws.com" target="test_blank">https://databricks-datasets-oregon.s3.us-west-2.amazonaws.com</A> quality/Bonus_jan.csv {} aws-sdk-java/1.12.101 Linux/5.4.0-1088-aws OpenJDK_64-Bit_Server_VM/25.342-b07 java/1.8.0_342 scala/2.12.14 kotlin/1.4.0 vendor/Private_Build cfg/retry-mode/legacy com.amazonaws.services.s3.transfer.TransferManager/1.12.101 com.amazonaws.services.s3.model.PutObjectRequest; Request ID: JN9487JSJFXDPAY8, Extended Request ID: zkWIIgPXRte6UWeXv5BzC/IzHXhqOntjdCyGiBw34+mm3qMi1irFm9jfY3/iwEfbt/0Ywz4TsKw=, Cloud Provider: AWS, Instance ID: i-0f553097120e72dd4 (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Request ID: JN9487JSJFXDPAY8; S3 Extended Request ID: zkWIIgPXRte6UWeXv5BzC/IzHXhqOntjdCyGiBw34+mm3qMi1irFm9jfY3/iwEfbt/0Ywz4TsKw=; Proxy: null), S3 Extended Request ID: zkWIIgPXRte6UWeXv5BzC/IzHXhqOntjdCyGiBw34+mm3qMi1irFm9jfY3/iwEfbt/0Ywz4TsKw=; nested exception is:</P><P></P><P></P><P></P> Wed, 09 Nov 2022 08:59:34 GMT https://community.databricks.com/t5/machine-learning/medium-datadriveninvestor-com/m-p/23101#M1305 THIAM_HUATTAN 2022-11-09T08:59:34Z https://community.databricks.com/t5/machine-learning/medium-datadriveninvestor-com/m-p/23102#M1306 <P>Hi @THIAM HUAT TAN​&nbsp;,</P><P></P><P>isn't this dbfs://databricks-datasets Databricks owned s3:// mounted to the workspace? </P><P>You got an error - 403 access denied to PUT files into the s3 bucket: <A href="https://databricks-datasets-oregon.s3.us-west-2.amazonaws.com" alt="https://databricks-datasets-oregon.s3.us-west-2.amazonaws.com" target="_blank">https://databricks-datasets-oregon.s3.us-west-2.amazonaws.com</A> </P><P></P><P>you should use some s3 bucket that you own and you can add files or if the file is small , you might be able to use dbfs://tmp/</P><P></P><P>thanks,</P><P>Pat.</P> Wed, 09 Nov 2022 12:21:21 GMT https://community.databricks.com/t5/machine-learning/medium-datadriveninvestor-com/m-p/23102#M1306 Pat 2022-11-09T12:21:21Z https://community.databricks.com/t5/machine-learning/medium-datadriveninvestor-com/m-p/23103#M1307 <P>I got the order of source and destination reversed. Now, it works, thanks <span class="lia-unicode-emoji" title=":thumbs_up:">👍</span></P> Wed, 09 Nov 2022 12:32:48 GMT https://community.databricks.com/t5/machine-learning/medium-datadriveninvestor-com/m-p/23103#M1307 THIAM_HUATTAN 2022-11-09T12:32:48Z