Databricks Community is the official forum for data engineers, data scientists, data enthusiasts and AI practitioners to ask questions, share knowledge, and collaborate on everything related to Databricks. Members can find answers, share best practices, and support each other in an environment that ensures respectful interactions.
I've set up the network security perimeter with Terraform using Configure an Azure network security perimeter for Azure resources - Azure Databricks | Microsoft Learn as my guide. All...
Hello Databricks Community, We are using Azure Databricks with Microsoft Entra ID (Azure AD) authentication. Our current login experience is the following: Access to the Databricks Account Conso...
My task is to make alert notification for prod target to pagerduty and e-mail, rest targets e-mail only. It is very easy for job or pipeline. In target you may define something like: databricks.yml...
We manage a databricks workspace where majority of the users are working, we haven't switched over to Serverless yet because there is lot of observability and control that is lacking. So we are still...
I recently bought an Instructor-Led Databricks Academy Course, but i am unable to see the option to download an invoice for my Corporate Reimbursement! Anyone aware of how to download or facing the ...
Hi, we have a Azure Databricks Workspace that uses Unity Catalog for storing data. We use a seperate storage account to store the catalogs. We need to enable the option "Infrastructure e...
Hi everyone, I am looking for a way to automatically create service principals, including their secrets, for M2M OAuth. I know that service principals can be created via the API, but it seems that ...
Hello there, Regarding the subject: Deploy Workloads with Lakeflow Jobs and Tasks, the current standard override rule seems to be reverted. "Job Parameters override Task Parameters when...
We are attempting to create a workspace on Databricks but encountering an issue Workspace provisioning has been stuck in PROVISIONING state for over 2 hours. Only partial resources were created (I...