Thanks for your reply. The user-managed identity is not the issue because I use it on ADF to pull data from the same storage account. I have followed the documentation for adding the managed identity to workspace. Perhaps my issue is the syntax code used inside the notebook. Maybe I need to get a token using a library? Any example or documentation would help.

I have tried

df = spark.read.format("delta").option("header", "true").load("abfss://{base folder}@{storage account name}.dfs.core.windows.net/{path to file}")
df.show()

i have also tried to use storage SDK and also tried to mount the storage but no success

from azure.storage.filedatalake import DataLakeServiceClient
from azure.identity import ManagedIdentityCredential credential = ManagedIdentityCredential()
 
service_client = DataLakeServiceClient( account_url=f"https://{storage_account_name}.dfs.core.windows.net", credential=credential )
# List filesystems (containers)
for filesystem in service_client.list_file_systems(): print(filesystem.name)

Can you point me to the correct documentation? I think my issues is what is inside the notebook.
 
Thanks again