cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

b_pinter
by Databricks Partner
  • 1501 Views
  • 5 replies
  • 2 kudos

Resolved! NetSuite JDBC Driver 8.10.184.0 Suppor

Hello,I am currently attempting to integrate NetSuite with Databricks using the NetSuite JDBC driver version 8.10.184.0. When I attempt to ingestion information from NetSuite to Databricks, I find that the job fails with a checksum error and informs ...

  • 1501 Views
  • 5 replies
  • 2 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 2 kudos

Hi @b_pinter, The NetSuite JDBC driver version 8.10.184.0 is indeed supported by Databricks for managed ingestion via Lakeflow Connect. The officially supported driver versions are 8.10.147.0, 8.10.170.0, and 8.10.184.0. The "JAR checksum does not ma...

  • 2 kudos
4 More Replies
MDAtl
by New Contributor II
  • 792 Views
  • 4 replies
  • 3 kudos

Resolved! Setting timezone at a workspace level

So all our on-prem datasources have timezones set to local (US East) and all timestamps stored in the table are in US East. As we're ETLing them to Databricks we're noticing that the same timestamp is now stored in UTC. So what was 6am in EST is now ...

  • 792 Views
  • 4 replies
  • 3 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 3 kudos

Hi @MDAtl, The short answer is no workspace-wide timezone setting for all Databricks compute. The long answer is that... this is expected TIMESTAMP behaviour. The timestamp values represent an absolute point in time, are normalised and persisted in U...

  • 3 kudos
3 More Replies
Javier_Epad
by New Contributor III
  • 1027 Views
  • 2 replies
  • 0 kudos

Resolved! Serverless NCC Private Endpoint ESTABLISHED but traffic routes via eth0 instead of PrivateLink (AWS

Hi community,I've been trying to connect Databricks Serverless to a SQL Serverrunning on an EC2 instance using NCC Private Endpoint, but trafficis not being routed through PrivateLink.## Setup- Databricks Serverless (AWS, us-east-1)- NCC attached to ...

  • 1027 Views
  • 2 replies
  • 0 kudos
Latest Reply
Javier_Epad
New Contributor III
  • 0 kudos

Louis thanks,My issue was with the NLB. The Databricks documentation does not specify some of the required settings for this configuration. I found the solution in this post:https://medium.com/databricks-platform-sme/aws-databricks-serverless-private...

  • 0 kudos
1 More Replies
mark_lenders
by New Contributor II
  • 743 Views
  • 2 replies
  • 0 kudos

Resolved! You have hit your free daily limit

Hello!I'm getting  "Error while starting SQL warehouse. Sorry, cannot run the resource because you have hit your free daily limit. Please come back again tomorrow."Do you know when exactly the reset happens?Thank you!

  • 743 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @mark_lenders, Hi, I don’t believe there’s a publicly documented exact reset time for this limit. The Databricks Free Edition limitations page shared by @balajij8 explains that if you exceed your quota, compute resources can become unavailable for...

  • 0 kudos
1 More Replies
Barnita
by New Contributor III
  • 1859 Views
  • 5 replies
  • 2 kudos

Resolved! How to run black code-formating on the notebooks using custom configurations in UI

Hi all,I’m currently exploring how we can format notebook code using Black (installed via libraries) with specific configurations.I understand that we can configure Black locally using a pyproject.toml file. However, I’d like to know if there’s a way...

  • 1859 Views
  • 5 replies
  • 2 kudos
Latest Reply
holunder42
New Contributor III
  • 2 kudos

I followed this description (black, pyproject.toml) and it worked for months.But now we found that the "format code" task does not consider pyproject.toml-defined line-length anymore.Is there any change in availability?

  • 2 kudos
4 More Replies
gusdiaso
by New Contributor
  • 276 Views
  • 1 replies
  • 0 kudos

Locked out of my own Workspace Admin (ID: 1885148383889850) - Need assistance

Hello community,I am a student learning Databricks on AWS. While trying to add a friend to a project, I accidentally removed my own user (gustavou.dias@gmail.com) from the native admins group inside my workspace.Since I am the only user and don't hav...

  • 276 Views
  • 1 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor
  • 0 kudos

Free Edition accounts are not covered by the Databricks support policy. You can create a new free workspace/account and migrate the assets. Export the items (notebooks etc) from the workspace and import them into the new one as its the quickest optio...

  • 0 kudos
koti521
by New Contributor II
  • 756 Views
  • 4 replies
  • 0 kudos

How to prevent direct workspace changes in Databricks by vendors / external users?

Hi Team,I’m looking for guidance on workspace governance and change control in Databricks, specifically related to vendor access.We recently observed that workspace-level changes seem to be applied directly, and we want to understand how this is happ...

  • 756 Views
  • 4 replies
  • 0 kudos
Latest Reply
emma_s
Databricks Employee
  • 0 kudos

Hi koti521, When you say vendor I'm assuming you mean Databricks, or is there other vendors you have in mind. Thoughts below. 1. Customer-controlled changes (configs, policies, permissions) are made by your admins, service principals, or automation, ...

  • 0 kudos
3 More Replies
calvp
by New Contributor II
  • 523 Views
  • 1 replies
  • 1 kudos

Resolved! Question About Workspace MFA Enforcement and Email OTP Behavior

Hello Databricks Community,We are using Azure Databricks with Microsoft Entra ID (Azure AD) authentication.Our current login experience is the following:Access to the Databricks Account Console requires Microsoft Entra MFA.The first access to a works...

  • 523 Views
  • 1 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hi, yes it is perfectly possible. The email flow only happens when you are using invite users by email as the way of adding users to the workspace. If you replace this so to use automatic identity management instead then it shouldn't need to do the e...

  • 1 kudos
rvm1975
by New Contributor III
  • 574 Views
  • 2 replies
  • 1 kudos

Resolved! How to make different notifications based on target for alert as part of bundle

My task is to make alert notification for prod target to pagerduty and e-mail, rest targets e-mail only.It is very easy for job or pipeline. In target you may define something like:databricks.yml targets: prod: resources: jobs: ma...

  • 574 Views
  • 2 replies
  • 1 kudos
Latest Reply
rvm1975
New Contributor III
  • 1 kudos

@balajij8 Thanks for the solution. Tested it and it's working. Totally forgot that variable can be list.

  • 1 kudos
1 More Replies
sparkplug
by Contributor
  • 1183 Views
  • 3 replies
  • 0 kudos

Resolved! Restrict certain queries on SQL Warehouse

We manage a databricks workspace where majority of the users are working, we haven't switched over to Serverless yet because there is lot of observability and control that is lacking. So we are still on one classic SQL warehouse which is shared among...

  • 1183 Views
  • 3 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @sparkplug, If you are using a shared classic SQL warehouse, I would set expectations that the native controls are fairly limited. The publicly documented knobs are mainly around warehouse sizing and queuing behaviour, warehouse monitoring, and st...

  • 0 kudos
2 More Replies
mariof
by New Contributor
  • 949 Views
  • 1 replies
  • 0 kudos

How to properly restrict public network access on Azure Databricks Managed Root Storage?

Hi,Our main goal right now is to disable public network access on the Managed Root Storage Account (the one created automatically in the managed resource group dbresources... which contains containers like ephemeral, root, meta, and unity-catalog-sto...

  • 949 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi  @mariof  ,It possible and all details are well described in following article:Enable firewall support for your workspace storage account - Azure Databricks | Microsoft LearnBefore enabling the firewall, the docs are explicit about several hard re...

  • 0 kudos
Khikmatullaev
by New Contributor
  • 745 Views
  • 1 replies
  • 0 kudos

Resolved! Premium account suspended 6+ days over a $0.51 invoice we can't pay — billing unresponsive

Hi all — hoping a Databricks employee or admin can help escalate.Our Premium account has been fully suspended for 6+ days because of a $0.51 past-due invoice. We cannot pay it: we have no NetSuite Customer Payment Portal login, and the payment link w...

  • 745 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @Khikmatullaev, I’m sorry you’ve been blocked for this long, especially over such a small past-due amount. Please send me a private DM with your Databricks account ID, affected workspace ID(s), invoice number (if you have it), and the open billing...

  • 0 kudos
Kirankumarbs
by Valued Contributor III
  • 709 Views
  • 2 replies
  • 3 kudos

Resolved! How to download Course Invoice from Databricks Academy

I recently bought an Instructor-Led Databricks Academy Course, but i am unable to see the option to download an invoice for my Corporate Reimbursement!Anyone aware of how to download or facing the same issue? I checked/skimmed all over Databricks Aca...

  • 709 Views
  • 2 replies
  • 3 kudos
Latest Reply
Kirankumarbs
Valued Contributor III
  • 3 kudos

@MoJaMa Thanks for your reply! Today i received an Invoice from Data bricks Academy Support!Let me mentioned it here so that if anyone else looking for similar help. I contacted Databricks Academy support through https://help.databricks.com/s/contact...

  • 3 kudos
1 More Replies
PabloCSD
by Valued Contributor II
  • 890 Views
  • 2 replies
  • 2 kudos

Pricing of Genie Space ChatBot

How much is the cost associated for making a ChatBot using this tool? Where can I find a source for the pricing of the tool?Thanks in advance

  • 890 Views
  • 2 replies
  • 2 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 2 kudos

Databricks recently published a new pricing model for all Genie products that will begin on July 6. Each user receives 150 DBUs of free large language model (LLM) usage every month, usage beyond the free amount is billed in DBUs, reflecting the under...

  • 2 kudos
1 More Replies