No such file or directory error when accessing Azure Storage Container through Unity Catalog

Data Engineering

Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.

Hello,

I have a Databricks notebook that is attempting to unzip an archive located in Azure Storage Container. Unity Catalog is setup to provide access to the container, yet I receive the following file not found error:

FileNotFoundError: [Errno 2] No such file or directory: 'abfss://pii@[REDACTED].dfs.core.windows.net/.../20190501-1.zip'

I assure you the file and directory do exist!

This is the code that is being executed.

if file_name.endswith(".zip"):
    with zipfile.ZipFile(file_directory + file_name, "r") as zip_ref:
        zip_ref.extractall(path=file_directory, pwd=zip_password.encode())

Is there any way around this problem without copying the file to local storage?