Databricks Community

Marthinus

Working with databricks asset bundles (using the new python-based definition), if you have a job_cluster defined using driver_node_type_id, and then update it to no longer have it defined, but only node_type_id, the driver node_type never gets update...

Marthinus · 06-04-2025

When working with Azure Databricks (with VNET injection) to connect securely to an Azure Storage account via private endpoint, there's a few locations it needs to connect to, firstly the vnet that databricks is connected to, which works well when con...

Marthinus

@dkushari no I don't think you understand me. When I unset driver_node_type_id, it does NOT revert to node_type_id.Perhaps an example will make it clear:First define cluster as:JobCluster( job_cluster_key="example", new_cluster=ClusterSpec( ...

Marthinus · 06-04-2025

I've read that in the documentation, and when I now tried with an Access Connector for Azure Databricks instead of my own service principal, it seems to have worked, shockingly, even if I completely block network access on the storage account with ze...

Databricks Community

User Stats

User Activity

[Databricks Asset Bundles] Bug: driver_node_type_id not updated

External Locations to Azure Storage via Private Endpoint

Re: [Databricks Asset Bundles] Bug: driver_node_type_id not updated

Re: External Locations to Azure Storage via Private Endpoint