permission denied listing external volume when using vscode databricks extension

[CDICSteph]

hey, i'm using the Db extension for vscode (Databricks connect v2). When using dbutils to list an external volume defined in UC like so: 

  dbutils.fs.ls("/Volumes/dev/bronze/rawdatafiles/")

i get this error: 

"databricks.sdk.errors.mapping.PermissionDenied: No operations allowed on this path..."

However, running the same statement in the Db workspace works fine. 

[Kaniz]

Hi @CDICSteph, Permissions on the Databricks filesystem (DBFS) path: Ensure that the service principal or the user ....

Databricks Connect version and configuration: Make sure you’re using a compatible version of Databricks Connect. Also, Databricks Connect V2 requires a cluster supporting the Unity Catalog. If you’re using a Data Access mode “No Isolation Shared” or you don’t have Unity Catalog at all, you....

Databricks workspace configuration: Check if there are any workspace-level settings or features that might be affecting the permissions. For example, there’s a feature called “Admin Protection for ‘No Isolation Shared’ Clusters” that mig....

[Kaniz]

Thank you for posting your question in our community! We are happy to assist you.

To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?

This will also help other community members who may have similar questions in the future. Thank you for your participation and let us know if you need any further assistance! 
 

[lukasjh]

We still face the problem (UC enabled shared cluster). Is there any resolution? @Kaniz 

[Kaniz]

Hi @lukasjh, 

• Ensure that the service principal or user account you’re using has the necessary permissions to access the specified path.
• Verify that the permissions are consistent between Databricks Connect and the Databricks workspace.
• Make sure you’re using a compatible version of Databricks Connect.
• Note that Databricks Connect V2 requires a cluster supporting the Unity Catalog. If you’re using a Data Access mode like “No Isolation Shared” or if Unity Catalog is not available, ...
• Check if any workspace-level settings or features are affecting permissions.
• For example, there’s a feature called “Admin Protection for ‘No Isolation Shared’ Clusters” that mig...
• Use a different cluster mode if applicable.
• Update spark.databricks.pyspark.enableProcessIsolation to false (if your cluster supports no isolation shared access mode).
• Alternatively, use standard cluster

Remember to review your configuration and permissions carefully to resolve this issue. If you need further assistance, feel free to ask! 😊

•  

[lukasjh]

Hi  @Kaniz,

thanks for your answer! Meanwhile we received the following answer from Azure Support: 

I have checked this internally and engaging the Databricks backline team and confirmed that, The Databrick connect does not support UC volume, and The Databricks engineering team is working on this, but we do not have any ETA as of now.

Can you confirm that accessing volumes should indeed not yet be possible using databricks-connect? 

Thanks