No such file or directory error when accessing Azure Storage Container through Unity Catalog

mdsilk77 — Wed, 17 Jul 2024 15:21:25 GMT

Hello,

I have a Databricks notebook that is attempting to unzip an archive located in Azure Storage Container. Unity Catalog is setup to provide access to the container, yet I receive the following file not found error:

FileNotFoundError: [Errno 2] No such file or directory: 'abfss://pii@[REDACTED].dfs.core.windows.net/.../20190501-1.zip'

I assure you the file and directory do exist!

This is the code that is being executed.

if file_name.endswith(".zip"): with zipfile.ZipFile(file_directory + file_name, "r") as zip_ref: zip_ref.extractall(path=file_directory, pwd=zip_password.encode())

Is there any way around this problem without copying the file to local storage?

topic No such file or directory error when accessing Azure Storage Container through Unity Catalog in Data Engineering

No such file or directory error when accessing Azure Storage Container through Unity Catalog