Not able to unzip the zip file with mount and unity catalog

[Gareema]

Hello Team, 

I have a zip file in ADLS Gen 2. The folder I am using is mounted and when I run command : dbutils.fs.ls(path) it lists all the files(including the zip require). 

However, when I try to read the zip using 'zipfile' module, it displays 'FileNotFoundError'. 

I am able to copy this file to volume from the mount point and unzip it and it is working fine. 
I want to use mounts for the time being. The file size is around 3GB and I am using unity catalog. 

I have tried using the method to convert zip to binary and then read, however there is a limitation of size in that case. 

My requirement is just to unzip the files after reading the metadata of the files before unzipping.

[Kaniz_Fatma]

Hi @Gareema, 

• Could you please ensure that the path you’re providing to the ZipFile constructor is correct? Please double-check the directory structure and make sure the file exists.
• You can use os.path.isdir(path) to verify if the directory exists. If it returns False, there might be an issue with the path.
• The zipfile module relies on the file extension to identify zip files. Make sure the file you’re trying to open has the correct .zip extension. If the file extension is different or missing, Python won’t recognize it as a zip file and throw the error.
• If your path length exceeds the Windows maximum path length (260 characters), it can cause issues. Consider using the //?/C prefix to handle long paths.
• The badzipfile error can occur if the ZIP file requires ZIP64 functionality but it hasn’t been enabled. Ensure that your Python environment supports ZIP64.

Let me know if this helps or if you need further assistance! 

[Gareema]

Thanks @Kaniz_Fatma . 

It is true that os.path.isdir(path) returns false, which is the major concern as when I try to use dbutils or just read the whole zip as a text file, it doesn't give an issue with the path. 
example:

but when I try to use it otherwise it fails with the message 'path not found'. 
I am using dbfs mount points and adls gen2 that is mounted to cluster.
so my path looks something like this: '/dbfs/mnt/<container-name>/<folder-name>'

Can this be a problem with the mounting or Unity Catalog? How could the same path be accessible to half features and half doesn't work?

[Witold]

@Gareema, since you're using UC, can you use Volumes instead? It basically replaces the old mount approach.

[Gareema]

@Witold, I know but there is a business limitation to that, so we currently can't move that. and till we move to volumes, some legacy data will be there so can't drop that as well.