topic permission denied listing external volume when using vscode databricks extension in Data Engineering

permission denied listing external volume when using vscode databricks extension

CDICSteph — Sun, 14 Jan 2024 00:30:22 GMT

hey, i'm using the Db extension for vscode (Databricks connect v2). When using dbutils to list an external volume defined in UC like so:

dbutils.fs.ls("/Volumes/dev/bronze/rawdatafiles/")

i get this error:

"databricks.sdk.errors.mapping.PermissionDenied: No operations allowed on this path..."

However, running the same statement in the Db workspace works fine.

Re: permission denied listing external volume when using vscode databricks extension

lukasjh — Tue, 16 Apr 2024 15:25:57 GMT

We still face the problem (UC enabled shared cluster). Is there any resolution? @Retired_mod

Re: permission denied listing external volume when using vscode databricks extension

lukasjh — Wed, 17 Apr 2024 13:35:13 GMT

Hi @Retired_mod,

thanks for your answer! Meanwhile we received the following answer from Azure Support:

I have checked this internally and engaging the Databricks backline team and confirmed that, The Databrick connect does not support UC volume, and The Databricks engineering team is working on this, but we do not have any ETA as of now.

Can you confirm that accessing volumes should indeed not yet be possible using databricks-connect?

Thanks

Re: permission denied listing external volume when using vscode databricks extension

NandiniN — Thu, 09 Jan 2025 11:32:31 GMT

I am able to list volumes in a shared UC cluster. I hope you are no more facing this.

Re: permission denied listing external volume when using vscode databricks extension

lukasjh2 — Thu, 09 Jan 2025 11:46:52 GMT

Works now also in VSCode with connect, at least it using dbutils from the workspace client instead of the spark session...

Re: permission denied listing external volume when using vscode databricks extension

NandiniN — Thu, 09 Jan 2025 15:07:24 GMT

great, thanks for confirming. This feature was under development in the early quarter last year. Now it is available.