cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

gusdiaso
by New Contributor
  • 75 Views
  • 1 replies
  • 0 kudos

Locked out of my own Workspace Admin (ID: 1885148383889850) - Need assistance

Hello community,I am a student learning Databricks on AWS. While trying to add a friend to a project, I accidentally removed my own user (gustavou.dias@gmail.com) from the native admins group inside my workspace.Since I am the only user and don't hav...

  • 75 Views
  • 1 replies
  • 0 kudos
Latest Reply
balajij8
Contributor III
  • 0 kudos

Free Edition accounts are not covered by the Databricks support policy. You can create a new free workspace/account and migrate the assets. Export the items (notebooks etc) from the workspace and import them into the new one as its the quickest optio...

  • 0 kudos
koti521
by New Contributor II
  • 465 Views
  • 4 replies
  • 0 kudos

How to prevent direct workspace changes in Databricks by vendors / external users?

Hi Team,I’m looking for guidance on workspace governance and change control in Databricks, specifically related to vendor access.We recently observed that workspace-level changes seem to be applied directly, and we want to understand how this is happ...

  • 465 Views
  • 4 replies
  • 0 kudos
Latest Reply
emma_s
Databricks Employee
  • 0 kudos

Hi koti521, When you say vendor I'm assuming you mean Databricks, or is there other vendors you have in mind. Thoughts below. 1. Customer-controlled changes (configs, policies, permissions) are made by your admins, service principals, or automation, ...

  • 0 kudos
3 More Replies
calvp
by New Contributor
  • 136 Views
  • 1 replies
  • 1 kudos

Resolved! Question About Workspace MFA Enforcement and Email OTP Behavior

Hello Databricks Community,We are using Azure Databricks with Microsoft Entra ID (Azure AD) authentication.Our current login experience is the following:Access to the Databricks Account Console requires Microsoft Entra MFA.The first access to a works...

  • 136 Views
  • 1 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hi, yes it is perfectly possible. The email flow only happens when you are using invite users by email as the way of adding users to the workspace. If you replace this so to use automatic identity management instead then it shouldn't need to do the e...

  • 1 kudos
rvm1975
by New Contributor III
  • 229 Views
  • 2 replies
  • 1 kudos

Resolved! How to make different notifications based on target for alert as part of bundle

My task is to make alert notification for prod target to pagerduty and e-mail, rest targets e-mail only.It is very easy for job or pipeline. In target you may define something like:databricks.yml targets: prod: resources: jobs: ma...

  • 229 Views
  • 2 replies
  • 1 kudos
Latest Reply
rvm1975
New Contributor III
  • 1 kudos

@balajij8 Thanks for the solution. Tested it and it's working. Totally forgot that variable can be list.

  • 1 kudos
1 More Replies
sparkplug
by Contributor
  • 420 Views
  • 3 replies
  • 0 kudos

Resolved! Restrict certain queries on SQL Warehouse

We manage a databricks workspace where majority of the users are working, we haven't switched over to Serverless yet because there is lot of observability and control that is lacking. So we are still on one classic SQL warehouse which is shared among...

  • 420 Views
  • 3 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @sparkplug, If you are using a shared classic SQL warehouse, I would set expectations that the native controls are fairly limited. The publicly documented knobs are mainly around warehouse sizing and queuing behaviour, warehouse monitoring, and st...

  • 0 kudos
2 More Replies
mariof
by New Contributor
  • 213 Views
  • 1 replies
  • 0 kudos

How to properly restrict public network access on Azure Databricks Managed Root Storage?

Hi,Our main goal right now is to disable public network access on the Managed Root Storage Account (the one created automatically in the managed resource group dbresources... which contains containers like ephemeral, root, meta, and unity-catalog-sto...

  • 213 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi  @mariof  ,It possible and all details are well described in following article:Enable firewall support for your workspace storage account - Azure Databricks | Microsoft LearnBefore enabling the firewall, the docs are explicit about several hard re...

  • 0 kudos
Khikmatullaev
by New Contributor
  • 238 Views
  • 1 replies
  • 0 kudos

Premium account suspended 6+ days over a $0.51 invoice we can't pay — billing unresponsive

Hi all — hoping a Databricks employee or admin can help escalate.Our Premium account has been fully suspended for 6+ days because of a $0.51 past-due invoice. We cannot pay it: we have no NetSuite Customer Payment Portal login, and the payment link w...

  • 238 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @Khikmatullaev, I’m sorry you’ve been blocked for this long, especially over such a small past-due amount. Please send me a private DM with your Databricks account ID, affected workspace ID(s), invoice number (if you have it), and the open billing...

  • 0 kudos
Kirankumarbs
by Contributor III
  • 412 Views
  • 2 replies
  • 3 kudos

Resolved! How to download Course Invoice from Databricks Academy

I recently bought an Instructor-Led Databricks Academy Course, but i am unable to see the option to download an invoice for my Corporate Reimbursement!Anyone aware of how to download or facing the same issue? I checked/skimmed all over Databricks Aca...

  • 412 Views
  • 2 replies
  • 3 kudos
Latest Reply
Kirankumarbs
Contributor III
  • 3 kudos

@MoJaMa Thanks for your reply! Today i received an Invoice from Data bricks Academy Support!Let me mentioned it here so that if anyone else looking for similar help. I contacted Databricks Academy support through https://help.databricks.com/s/contact...

  • 3 kudos
1 More Replies
PabloCSD
by Valued Contributor II
  • 328 Views
  • 2 replies
  • 2 kudos

Pricing of Genie Space ChatBot

How much is the cost associated for making a ChatBot using this tool? Where can I find a source for the pricing of the tool?Thanks in advance

  • 328 Views
  • 2 replies
  • 2 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 2 kudos

Databricks recently published a new pricing model for all Genie products that will begin on July 6. Each user receives 150 DBUs of free large language model (LLM) usage every month, usage beyond the free amount is billed in DBUs, reflecting the under...

  • 2 kudos
1 More Replies
158576
by New Contributor
  • 443 Views
  • 2 replies
  • 0 kudos

mount cifs volume on all purpose compute results in permission denied

I have all networking already set, nslookup resolves NAS server IP and connectivity is enabled from worker nodes to nas server. I am able to mount the same nas drive outside of databricks, I mean standalone linux vm in the same VPC where worker nodes...

  • 443 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @158576, Sorry for the delay in getting back to you, and just closing the loop in case you’re still expecting an answer. Thanks for sharing the details. Based on what you’ve already validated, this does not sound like a basic networking problem. I...

  • 0 kudos
1 More Replies
margarita_shir
by New Contributor III
  • 989 Views
  • 4 replies
  • 2 kudos

AWS DATABRICKS COMPUTE COSTS IN USAGE DASHBOARDS

Good afternoon!I know that the built-in Databricks usage dashboards currently only display DBU (Databricks Unit) usage. Our Databricks workspaces are running on AWS, and the clusters provision EC2 instances automatically.I would like to include the u...

  • 989 Views
  • 4 replies
  • 2 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 2 kudos

Hi @margarita_shir, If you are still looking for an answer... the right way to bring underlying EC2 cost into your reporting is to use Databricks system tables for the Databricks side of the picture and AWS billing data for the cloud side. The built-...

  • 2 kudos
3 More Replies
Rjdudley
by Honored Contributor
  • 340 Views
  • 1 replies
  • 0 kudos

Resolved! network security perimeter post-setup questions

I've set up the network security perimeter with Terraform using Configure an Azure network security perimeter for Azure resources - Azure Databricks | Microsoft Learn as my guide.  All of the resources associated to the NSP, and the Status of each is...

Rjdudley_0-1780421763241.png
  • 340 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Greetings @Rjdudley , I did some digging and here is what I found: Good news on both counts. Neither of these means your NSP setup is broken. On the MissingIdentityConfiguration issue, you can ignore it for what you're doing. It's a generic Azure NS...

  • 0 kudos
Javier_Epad
by New Contributor
  • 239 Views
  • 1 replies
  • 0 kudos

Serverless NCC Private Endpoint ESTABLISHED but traffic routes via eth0 instead of PrivateLink (AWS

Hi community,I've been trying to connect Databricks Serverless to a SQL Serverrunning on an EC2 instance using NCC Private Endpoint, but trafficis not being routed through PrivateLink.## Setup- Databricks Serverless (AWS, us-east-1)- NCC attached to ...

  • 239 Views
  • 1 replies
  • 0 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 0 kudos

Hey @Javier_Epad , I did some digging and here is what I found: This is not a case of internal NLBs being unsupported. The AWS docs spell out serverless private connectivity to your VPC through an internal NLB sitting behind a VPC endpoint service, s...

  • 0 kudos
venkat-raghavan
by New Contributor III
  • 224 Views
  • 2 replies
  • 0 kudos

AI Governance via UC MCP connection

AI Governance via UC MCP ConnectionI can not figure out how to make the policy  option show up in the GUI to allow me to attach a policy to the MCP server. The "Policies" option is not showing for me even though I can confirm I have it enabled:See im...

image (6).png image (5).png
  • 224 Views
  • 2 replies
  • 0 kudos
Latest Reply
anmolhhns
New Contributor III
  • 0 kudos

Hey,Contact your Databricks account representative or support team and request enrollment in the Service Policies for MCP gated beta.

  • 0 kudos
1 More Replies
yustus
by New Contributor III
  • 404 Views
  • 2 replies
  • 2 kudos

Resolved! API - Service Principle Secret Generation

Hi everyone,I am looking for a way to automatically create service principals, including their secrets, for M2M OAuth.I know that service principals can be created via the API, but it seems that creating secrets for those service principals via the A...

  • 404 Views
  • 2 replies
  • 2 kudos
Latest Reply
ShamenParis
New Contributor III
  • 2 kudos

Hi @yustus It’s great that you are prioritizing secure M2M OAuth over OBO tokens!while @szymon_dybczak already mentioned the Python SDK and Terraform, I wanted to offer a few alternative approaches depending on how your automation is set up:1. The Di...

  • 2 kudos
1 More Replies