topic Re: File copy in adls in Data Engineering

File copy in adls

databicky — Sat, 08 Jul 2023 04:41:21 GMT

i am using dbutils.fs.copy(abfss://container/provsn/filen[ame.txt,abfss://container/data/sasam.txt)

while.trying this copy method to copy the files it is showing urisyntax exception near the square bracket how can i read and copy it

Re: File copy in adls

Chaitanya_Raju — Sat, 08 Jul 2023 11:12:29 GMT

Can you please post the image of what exactly you tried and what error you are facing , so that it will be helpful to understand the error easily.

Re: File copy in adls

Anonymous — Sun, 09 Jul 2023 04:20:37 GMT

Hi @databicky

We haven't heard from you since the last response from @Chaitanya_Raju, and I was checking back to see if his suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

Re: File copy in adls

databicky — Mon, 10 Jul 2023 17:20:11 GMT

Re: File copy in adls

Hemant — Mon, 10 Jul 2023 04:24:08 GMT

Hi @databicky ,

To copy or move data from one folder to another folder in Azure Data Lake Storage (ADLS), you must first create a mount point for that container. A mount point is a directory on your driver that is linked to a specific container in ADLS. Once you have created a mount point, you can access the data in the container as if it were on your DBFS.

Re: File copy in adls

dplante — Mon, 10 Jul 2023 03:59:54 GMT

From looking at stack trace, it looks like URIException. Easiest solution would be renaming the file so that there are no square brackets in the filename.

If this is not an option, it might help to URLEncode the path - https://stackoverflow.com/questions/56787003/how-to-fix-an-uriexception-about-an-illegal-character-in-query

Also, check this stack overflow - https://stackoverflow.com/questions/68773102/spark-cannot-read-file-with-square-brackets-in-the-file-path

HTH