Following are may be the Causes
1. Different authentication methods
- The UI's external location uses Unity Catalog credentials
- Your dbutils.fs.ls() command uses the compute's Spark configurations
- These may be using different credentials with different permissions

2. Missing Spark configurations
- Your compute might not have the necessary ADLS Gen2 authentication configs

3. Credential permissions
- The credential might have container-level LIST but not deeper TRAVERSE/READ permissions

How to Diagnose

1. Check compute type

• Are you using server less, shared, or single-user compute?
• Unity Catalog-enabled clusters handle credentials differently

Solutions
Option 1: Use Unity Catalog Volumes

Option 2: Add Spark configurations to your compute Add these to your cluster's Spark Config (Cluster → Configuration → Advanced Options)