Hello Team,
I have a zip file in ADLS Gen 2. The folder I am using is mounted and when I run command : dbutils.fs.ls(path) it lists all the files(including the zip require).
However, when I try to read the zip using 'zipfile' module, it displays 'FileNotFoundError'.
I am able to copy this file to volume from the mount point and unzip it and it is working fine.
I want to use mounts for the time being. The file size is around 3GB and I am using unity catalog.
I have tried using the method to convert zip to binary and then read, however there is a limitation of size in that case.
My requirement is just to unzip the files after reading the metadata of the files before unzipping.
Thanks @Retired_mod .
It is true that os.path.isdir(path) returns false, which is the major concern as when I try to use dbutils or just read the whole zip as a text file, it doesn't give an issue with the path.
example:
but when I try to use it otherwise it fails with the message 'path not found'.
I am using dbfs mount points and adls gen2 that is mounted to cluster.
so my path looks something like this: '/dbfs/mnt/<container-name>/<folder-name>'
Can this be a problem with the mounting or Unity Catalog? How could the same path be accessible to half features and half doesn't work?
