cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Javier_Epad
by New Contributor III
  • 1198 Views
  • 2 replies
  • 0 kudos

Resolved! Serverless NCC Private Endpoint ESTABLISHED but traffic routes via eth0 instead of PrivateLink (AWS

Hi community,I've been trying to connect Databricks Serverless to a SQL Serverrunning on an EC2 instance using NCC Private Endpoint, but trafficis not being routed through PrivateLink.## Setup- Databricks Serverless (AWS, us-east-1)- NCC attached to ...

  • 1198 Views
  • 2 replies
  • 0 kudos
Latest Reply
Javier_Epad
New Contributor III
  • 0 kudos

Louis thanks,My issue was with the NLB. The Databricks documentation does not specify some of the required settings for this configuration. I found the solution in this post:https://medium.com/databricks-platform-sme/aws-databricks-serverless-private...

  • 0 kudos
1 More Replies
mark_lenders
by New Contributor II
  • 846 Views
  • 2 replies
  • 0 kudos

Resolved! You have hit your free daily limit

Hello!I'm getting  "Error while starting SQL warehouse. Sorry, cannot run the resource because you have hit your free daily limit. Please come back again tomorrow."Do you know when exactly the reset happens?Thank you!

  • 846 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @mark_lenders, Hi, I don’t believe there’s a publicly documented exact reset time for this limit. The Databricks Free Edition limitations page shared by @balajij8 explains that if you exceed your quota, compute resources can become unavailable for...

  • 0 kudos
1 More Replies
Barnita
by New Contributor III
  • 1971 Views
  • 5 replies
  • 2 kudos

Resolved! How to run black code-formating on the notebooks using custom configurations in UI

Hi all,I’m currently exploring how we can format notebook code using Black (installed via libraries) with specific configurations.I understand that we can configure Black locally using a pyproject.toml file. However, I’d like to know if there’s a way...

  • 1971 Views
  • 5 replies
  • 2 kudos
Latest Reply
holunder42
New Contributor III
  • 2 kudos

I followed this description (black, pyproject.toml) and it worked for months.But now we found that the "format code" task does not consider pyproject.toml-defined line-length anymore.Is there any change in availability?

  • 2 kudos
4 More Replies
gusdiaso
by New Contributor
  • 312 Views
  • 1 replies
  • 0 kudos

Locked out of my own Workspace Admin (ID: 1885148383889850) - Need assistance

Hello community,I am a student learning Databricks on AWS. While trying to add a friend to a project, I accidentally removed my own user (gustavou.dias@gmail.com) from the native admins group inside my workspace.Since I am the only user and don't hav...

  • 312 Views
  • 1 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 0 kudos

Free Edition accounts are not covered by the Databricks support policy. You can create a new free workspace/account and migrate the assets. Export the items (notebooks etc) from the workspace and import them into the new one as its the quickest optio...

  • 0 kudos
koti521
by New Contributor II
  • 840 Views
  • 4 replies
  • 0 kudos

How to prevent direct workspace changes in Databricks by vendors / external users?

Hi Team,I’m looking for guidance on workspace governance and change control in Databricks, specifically related to vendor access.We recently observed that workspace-level changes seem to be applied directly, and we want to understand how this is happ...

  • 840 Views
  • 4 replies
  • 0 kudos
Latest Reply
emma_s
Databricks Employee
  • 0 kudos

Hi koti521, When you say vendor I'm assuming you mean Databricks, or is there other vendors you have in mind. Thoughts below. 1. Customer-controlled changes (configs, policies, permissions) are made by your admins, service principals, or automation, ...

  • 0 kudos
3 More Replies
calvp
by New Contributor II
  • 601 Views
  • 1 replies
  • 1 kudos

Resolved! Question About Workspace MFA Enforcement and Email OTP Behavior

Hello Databricks Community,We are using Azure Databricks with Microsoft Entra ID (Azure AD) authentication.Our current login experience is the following:Access to the Databricks Account Console requires Microsoft Entra MFA.The first access to a works...

  • 601 Views
  • 1 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hi, yes it is perfectly possible. The email flow only happens when you are using invite users by email as the way of adding users to the workspace. If you replace this so to use automatic identity management instead then it shouldn't need to do the e...

  • 1 kudos
rvm1975
by New Contributor III
  • 661 Views
  • 2 replies
  • 1 kudos

Resolved! How to make different notifications based on target for alert as part of bundle

My task is to make alert notification for prod target to pagerduty and e-mail, rest targets e-mail only.It is very easy for job or pipeline. In target you may define something like:databricks.yml targets: prod: resources: jobs: ma...

  • 661 Views
  • 2 replies
  • 1 kudos
Latest Reply
rvm1975
New Contributor III
  • 1 kudos

@balajij8 Thanks for the solution. Tested it and it's working. Totally forgot that variable can be list.

  • 1 kudos
1 More Replies
sparkplug
by Contributor
  • 1308 Views
  • 3 replies
  • 0 kudos

Resolved! Restrict certain queries on SQL Warehouse

We manage a databricks workspace where majority of the users are working, we haven't switched over to Serverless yet because there is lot of observability and control that is lacking. So we are still on one classic SQL warehouse which is shared among...

  • 1308 Views
  • 3 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @sparkplug, If you are using a shared classic SQL warehouse, I would set expectations that the native controls are fairly limited. The publicly documented knobs are mainly around warehouse sizing and queuing behaviour, warehouse monitoring, and st...

  • 0 kudos
2 More Replies
mariof
by New Contributor
  • 1091 Views
  • 1 replies
  • 0 kudos

How to properly restrict public network access on Azure Databricks Managed Root Storage?

Hi,Our main goal right now is to disable public network access on the Managed Root Storage Account (the one created automatically in the managed resource group dbresources... which contains containers like ephemeral, root, meta, and unity-catalog-sto...

  • 1091 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi  @mariof  ,It possible and all details are well described in following article:Enable firewall support for your workspace storage account - Azure Databricks | Microsoft LearnBefore enabling the firewall, the docs are explicit about several hard re...

  • 0 kudos
Khikmatullaev
by New Contributor
  • 810 Views
  • 1 replies
  • 0 kudos

Resolved! Premium account suspended 6+ days over a $0.51 invoice we can't pay — billing unresponsive

Hi all — hoping a Databricks employee or admin can help escalate.Our Premium account has been fully suspended for 6+ days because of a $0.51 past-due invoice. We cannot pay it: we have no NetSuite Customer Payment Portal login, and the payment link w...

  • 810 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @Khikmatullaev, I’m sorry you’ve been blocked for this long, especially over such a small past-due amount. Please send me a private DM with your Databricks account ID, affected workspace ID(s), invoice number (if you have it), and the open billing...

  • 0 kudos
Kirankumarbs
by Valued Contributor III
  • 778 Views
  • 2 replies
  • 3 kudos

Resolved! How to download Course Invoice from Databricks Academy

I recently bought an Instructor-Led Databricks Academy Course, but i am unable to see the option to download an invoice for my Corporate Reimbursement!Anyone aware of how to download or facing the same issue? I checked/skimmed all over Databricks Aca...

  • 778 Views
  • 2 replies
  • 3 kudos
Latest Reply
Kirankumarbs
Valued Contributor III
  • 3 kudos

@MoJaMa Thanks for your reply! Today i received an Invoice from Data bricks Academy Support!Let me mentioned it here so that if anyone else looking for similar help. I contacted Databricks Academy support through https://help.databricks.com/s/contact...

  • 3 kudos
1 More Replies
PabloCSD
by Valued Contributor II
  • 1077 Views
  • 2 replies
  • 2 kudos

Pricing of Genie Space ChatBot

How much is the cost associated for making a ChatBot using this tool? Where can I find a source for the pricing of the tool?Thanks in advance

  • 1077 Views
  • 2 replies
  • 2 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 2 kudos

Databricks recently published a new pricing model for all Genie products that will begin on July 6. Each user receives 150 DBUs of free large language model (LLM) usage every month, usage beyond the free amount is billed in DBUs, reflecting the under...

  • 2 kudos
1 More Replies
158576
by New Contributor
  • 615 Views
  • 2 replies
  • 0 kudos

mount cifs volume on all purpose compute results in permission denied

I have all networking already set, nslookup resolves NAS server IP and connectivity is enabled from worker nodes to nas server. I am able to mount the same nas drive outside of databricks, I mean standalone linux vm in the same VPC where worker nodes...

  • 615 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @158576, Sorry for the delay in getting back to you, and just closing the loop in case you’re still expecting an answer. Thanks for sharing the details. Based on what you’ve already validated, this does not sound like a basic networking problem. I...

  • 0 kudos
1 More Replies
margarita_shir
by New Contributor III
  • 1738 Views
  • 4 replies
  • 2 kudos

AWS DATABRICKS COMPUTE COSTS IN USAGE DASHBOARDS

Good afternoon!I know that the built-in Databricks usage dashboards currently only display DBU (Databricks Unit) usage. Our Databricks workspaces are running on AWS, and the clusters provision EC2 instances automatically.I would like to include the u...

  • 1738 Views
  • 4 replies
  • 2 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 2 kudos

Hi @margarita_shir, If you are still looking for an answer... the right way to bring underlying EC2 cost into your reporting is to use Databricks system tables for the Databricks side of the picture and AWS billing data for the cloud side. The built-...

  • 2 kudos
3 More Replies