Databricks Community

mzs · 08-19-2025

Hi,I'm setting up a workspace in Azure with VNet injection. I'm able to upload files to a Unity Catalog managed storage account volume through the web UI, and access them from notebooks using serverless compute, for example, `dbutils.fs.list("/Volume...

mzs · 05-19-2025

By default, the "users" and "admins" groups have CAN_USE permission on the Personal Compute policy.I'm using Terraform and would like to prevent regular users from using this policy to create additional compute clusters.I haven't found a way to do th...

mzs · 03-22-2025

Hi,I've been reading up on private link (https://learn.microsoft.com/en-us/azure/databricks/security/network/classic/private-link) and have some questions:In the standard deployment, do the transit VNet (frontend private endpoint) and Databricks work...

mzs · 03-16-2025

Hi,I'm setting up a workspace in Azure and would like to put some restrictions in place on outbound Internet access to reduce the risk of data exfiltration from notebooks and jobs. I plan to use VNet Injection and SCC + back-end private link for comp...

mzs

The problem was actually with DBFS and the internal Databricks-managed storage account firewall, not even with the storage account my catalog is using. The cluster event logs would occasionally show "DBFS is down".In Terraform, in my azurerm_databric...

mzs · 08-20-2025

Is there a way to get some diagnostic information from the underlying libraries? Maybe an environment variable I can pass or set on the cluster level, that would show up in the Spark driver or worker logs?I think that stack trace is from the old Azur...

mzs · 08-20-2025

Hi, I don't have any private endpoints.I was using service endpoints but at this point I've removed the service endpoints and opened up the storage network restrictions to all public networks, and it still hits the same error.

mzs · 05-20-2025

I learned the Personal Compute policy can be turned off at the account level:https://learn.microsoft.com/en-us/azure/databricks/admin/clusters/personal-compute#manage-policy

mzs · 03-22-2025

Thanks Isi, this is great info. I'll update once I've tried it.

Databricks Community

User Stats

User Activity

Compute cluster in Azure workspace is unable to access Unity Catalog volume on storage account

Removing compute policy permissions using Terraform

Understanding Azure frontend private link endpoints

Using a proxy server to install packages from PyPI in Azure Databricks

Re: Compute cluster in Azure workspace is unable to access Unity Catalog volume on storage account

Re: Compute cluster in Azure workspace is unable to access Unity Catalog volume on storage account

Re: Compute cluster in Azure workspace is unable to access Unity Catalog volume on storage account

Re: Removing compute policy permissions using Terraform

Re: Using a proxy server to install packages from PyPI in Azure Databricks