Databricks Community

AlbertWang

Hi all,I am not sure whether this is a bug. I followed the document.My databricks.yml file: bundle: name: test variables: DATABRICKS_HOST: description: The host of the Databricks workspace. DATABRICKS_JOB_RUNNING_SERVICE_PRINCIPAL_CLIENT_I...

AlbertWang

Hi all,I created an Azure Databricks workspace with the below featuresDeployed in my Azure virtual network (VNet injection)Enabled Secure cluster connectivityEnabled the Back-end Private LinkI did not create and use a NAT. I found that I still can ac...

AlbertWang · 08-08-2024

The problemAfter setting up Unity Catalog and a managed Volume, I can upload/download files to/from the volume, on Databricks Workspace UI.However, I cannot access the volume from notebook. I created an All-purpose compute, and run dbutils.fs.ls("/Vo...

AlbertWang · 08-07-2024

We have set up Azure Databricks with Unity Catalog (Metastore).Used Managed Identity (Databricks Access Connector) for connection from workspace(s) to ADLS Gen2ADLS Gen2 storage account has Storage Blob Data Contributor and Storage Queue Data Contrib...

AlbertWang

Thank you, @filipniziol. Even though I don't know why, but since it is a documented feature, it is not a bug 

AlbertWang

Thank you for your kind reply, @Witold. May I ask why host should not be variable? Is there any specific reason?I use Azure DevOps pipelines as the CI/CD tool. So I define the host in variable groups. I don't want to define it again in a different lo...

AlbertWang

@Volker @kunalmishra9 Tested the below element is not necessary.num_workers: 0

AlbertWang

@Volker @kunalmishra9 As answered by Ganesh Chandrasekaran , the below solution works. I tested. Btw, you need to keep both spark_conf and custom_tags. job_clusters: - job_cluster_key: job_cluster new_cluster: spark_v...

AlbertWang

Hi @szymon_dybczak Thank you for your reply.Do you mean "If you choose SCC option, there should be NAT gateway created"?I checked there was no NAT created. Moreover, I have no Azure Firewall, Load Balancer, and NAT gateway, but my compute still can c...

Databricks Community

User Stats

User Activity

Databricks bundle custom variables feature does not work for workspace host

Confusion about SCC, NAT, and Internet connection (Azure)

Azure Databricks Unity Catalog - Cannot access Managed Volume in notebook

Azure Databricks Unity Catalog - cannot access managed volume in notebook

Re: Databricks bundle custom variables feature does not work for workspace host

Re: Databricks bundle custom variables feature does not work for workspace host

Re: Asset Bundles cannot run job with single node job cluster

Re: Asset Bundles cannot run job with single node job cluster

Re: Confusion about SCC, NAT, and Internet connection (Azure)