cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

noorbasha534
by • Valued Contributor II
  • 11326 Views
  • 6 replies
  • 1 kudos

Azure Databricks Status

Dear all,I wanted to check if anyone implemented the solution of capturing information from Databricks status page in real-time 24x7 and load that into a log or table...https://learn.microsoft.com/en-us/azure/databricks/resources/statuswhat is the be...

  • 11326 Views
  • 6 replies
  • 1 kudos
Latest Reply
jaxsjin
Visitor
  • 1 kudos

For Tele Latino, monitoring service availability through webhooks and storing downtime records in a database could be a practical solution.https://dramalivedl.comThis would help track uptime, identify service interruptions, and generate useful perfor...

  • 1 kudos
5 More Replies
julien_inquipus
by • New Contributor
  • 89 Views
  • 1 replies
  • 1 kudos

Serverless egress blocked (DNS REFUSED) on a Premium AWS workspace created via Express – only pypi/g

Hello,We run our platform on Databricks on AWS (eu-central-1). The workspace was created through the Express sign-up in early November 2026, then upgraded to Premium, and a credit card has been added to the account (pay-as-you-go). Compute is serverl...

  • 89 Views
  • 1 replies
  • 1 kudos
Latest Reply
ThomazNeto
Databricks Partner
  • 1 kudos

Hi @julien_inquipus ,Short version: there's no documented setting a Premium account can change for this, and I couldn't find a Databricks statement on how this restriction gets lifted. What the docs do say at least explains why nothing on the network...

  • 1 kudos
billpchie
by • New Contributor III
  • 332 Views
  • 5 replies
  • 5 kudos

Resolved! Databricks Unity Catalog JDBC Connection: Can properties reference Databricks Secrets

I'm creating a JDBC connection in Databricks Unity Catalog to connect to Trino.The connection requires SSL configuration, including a client keystore and truststore.When creating the connection through the Databricks UI, I enter these as key-value pa...

  • 332 Views
  • 5 replies
  • 5 kudos
Latest Reply
Yougasundar
New Contributor III
  • 5 kudos

Hi @billpchie,On your first question: the CREATE CONNECTION reference says that for any option that carries a credential, you should use the secret function instead of a literal value. So create the connection in SQL instead of the UI, for example wi...

  • 5 kudos
4 More Replies
Ignacio_Soler
by • New Contributor
  • 275 Views
  • 2 replies
  • 2 kudos

Private network gateway (ALL_TRAFFIC): serverless can't reach on-prem by raw IPv4, only by hostname

Hi all,We're testing the private network gateway (Beta) on Azure Databricks so that serverless compute egresses through a subnet in our VNet and reaches on-prem resources (through a hub firewall + ExpressRoute/VPN) from a predictable IP range.Setup- ...

  • 275 Views
  • 2 replies
  • 2 kudos
Latest Reply
Yougasundar
New Contributor III
  • 2 kudos

Hi @Ignacio_Soler,Your test write-up is very clear, and I read the docs the same way you do. The Azure page describes destinations only as DNS names. Its routing table ends with "Default Azure Databricks serverless egress: All other outbound traffic"...

  • 2 kudos
1 More Replies
chandru44
by • Databricks Partner
  • 10287 Views
  • 4 replies
  • 2 kudos

Resolved! Networking Challenges with Databricks Serverless Compute (Control Plane) When Connecting to On-Prem

Hi Databricks Community,I'm working through some networking challenges when connecting Databricks clusters to various data sources and wanted to get advice or best practices from others who may have faced similar issues.Current Setup:I have four type...

Databricks Serverless Community Post.drawio (2).png
  • 10287 Views
  • 4 replies
  • 2 kudos
Latest Reply
Praveen_sriram
New Contributor
  • 2 kudos

Hi @chandru44 and @bitc, I’m adding an update because this thread still comes up for anyone researching this topic, and a few things have changed since the accepted answer. Thanks @Louis_Frolio, the hybrid sync pattern is still the right default for ...

  • 2 kudos
3 More Replies
saurabh18cs
by • Honored Contributor III
  • 311 Views
  • 4 replies
  • 3 kudos

Databricks Exclusive Access

I’m exploring how to set up exclusive access for separate use cases implementation within a shared Databricks workspace, using Microsoft Entra groups and Unity Catalog. I’d love to hear from anyone who has implemented something similar, or is current...

  • 311 Views
  • 4 replies
  • 3 kudos
Latest Reply
balajij8
Esteemed Contributor III
  • 3 kudos

You can start by granting privileges strictly to synced Entra groups and use automatic identity management to structure Unity Catalog privileges for use case isolation while keeping central oversight intact. Dont use legacy SCIM connector as automati...

  • 3 kudos
3 More Replies
revian
by • New Contributor II
  • 1651 Views
  • 12 replies
  • 1 kudos

Serverless DNS failures after trial upgrade (AWS us-east-2)

Our AWS Premium serverless workspace in us-east-2 cannot resolve several public domains. We added a payment method, and the account UI confirms that the trial upgrade is complete.Three fresh serverless notebook runs on September 24, 2026, at approxim...

  • 1651 Views
  • 12 replies
  • 1 kudos
Latest Reply
Liam3456
New Contributor
  • 1 kudos

Thanks for sharing the details of this issue. DNS failures after upgrading from a trial account can be quite frustrating, especially when serverless resources suddenly stop working as expected. It would be helpful to check whether the problem is rela...

  • 1 kudos
11 More Replies
xavi-albert
by • New Contributor II
  • 312 Views
  • 2 replies
  • 1 kudos

"account users" system group has the Account admin role. Can it be removed, and how do we get a per-

We manage Databricks on AWS with Terraform (databricks provider 1.x), using one Unity Catalog metastore shared by several workspaces. Each customer gets its own workspace, an ISOLATED catalog, an ISOLATED storage credential, and an ISOLATED external ...

  • 312 Views
  • 2 replies
  • 1 kudos
Latest Reply
xavi-albert
New Contributor II
  • 1 kudos

Hi @saurabh18cs , thank you for the reply! I can confirm that Account admin was turned on for the Databricks managed account users group by someone and we since turned it off. I can now proceed with my build.

  • 1 kudos
1 More Replies
ryanforsythe8
by • New Contributor
  • 281 Views
  • 3 replies
  • 0 kudos

Unable to user serverless GPU

I am currently using a premium plan, it was set up as a managed databricks account (no attached cloud account). I do have a credit card attached to the account, so it does not say "free trial". When I try to use a serverless GPU, I get the error "An ...

  • 281 Views
  • 3 replies
  • 0 kudos
Latest Reply
ryanforsythe8
New Contributor
  • 0 kudos

Thanks for the response, that is the same error that I am getting but according to the documentation I should have access. I am on a premium tier (credit card entered) workspace, on AWS in the us-east-2 region. According to documentation for AWS serv...

  • 0 kudos
2 More Replies
MonikaGarg
by • New Contributor
  • 578 Views
  • 3 replies
  • 0 kudos

Workspaces Prefetch error: 500

I registered for Databricks Free Edition using Google authentication. Google login succeeds and I can see my account name. However, when I select my account to enter the workspace, I receive a "Workspaces Prefetch error: 500". This also happens in an...

  • 578 Views
  • 3 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @MonikaGarg, Workspaces Prefetch error: 500" and the GetFilebrowserHeaderFolder ... temporarily unavailable message are both server-side errors. They come from the backend that serves your workspace, not from your browser. That's why the hard refr...

  • 0 kudos
2 More Replies
mksmith521
by • New Contributor II
  • 761 Views
  • 3 replies
  • 2 kudos

Resolved! rich colors affected by recent dark mode update

Hello,I use rich Consoles to print DataFrame modification statistics, and I use dark mode. Up until a few days ago, Databricks handled dark mode by inverting rich's colors. That was fine, I just inverted the colors I wanted before passing them into r...

  • 761 Views
  • 3 replies
  • 2 kudos
Latest Reply
Andreas_DBR
Databricks Employee
  • 2 kudos

Hi @mksmith521,   Thanks for the careful report, and for measuring the color with a picker. You're right: bright_red inside a class="nodarkmode" wrapper does not come back as FF0000. What you're seeing is a limitation of the CSS filter capabilities ...

  • 2 kudos
2 More Replies
Andrew_Barlow
by • New Contributor II
  • 329 Views
  • 2 replies
  • 2 kudos

Resolved! AIM configuration on Databricks (AWS)

Hello,We want to manage our users and groups (not service principals) via AIM on our databricks platform which sits on AWS. This is an existing platform with manually created users and groupsIn the documentation it refers to the externalID of both th...

  • 329 Views
  • 2 replies
  • 2 kudos
Latest Reply
Andrew_Barlow
New Contributor II
  • 2 kudos

Thanks Nina - this was really helpful.

  • 2 kudos
1 More Replies
dans-vander
by • New Contributor II
  • 649 Views
  • 2 replies
  • 0 kudos

[FGAC_ON_DEDICATED_COMPUTE_FAILED] Fine-grained access control (FGAC) on dedicated compute failed

Hi everyone, Starting this thread to check if anyone else has seen a similar issue, and sharing the solution because in our case, it was a detail we hadn't noticed it in the documentation. https://docs.databricks.com/aws/en/compute/single-user-fgac P...

dansvander_0-1789651121627.png dansvander_1-1789652090146.png dansvander_2-1789652099168.png
Administration & Architecture
Databricks Administration
serverless
  • 649 Views
  • 2 replies
  • 0 kudos
Latest Reply
saurabh18cs
Honored Contributor III
  • 0 kudos

Hi @dans-vander  By default Databricks Serverless generic compute cannot reach any of private Azure resources. To enable connectivity a private endpoint is needed. Unfortunately setup does not have unlimited private endpoints that can be used with th...

  • 0 kudos
1 More Replies
tedlo042034
by • New Contributor III
  • 660 Views
  • 3 replies
  • 0 kudos

Resolved! "Organization permissions" in DAB's

Hi all,I've created a Databricks app in git, and it is deployed through DAB's. I want my team to have access to it and manage it and view insights and logs thus i have added in the dab CAN_MANAGE permission to my App DAB to the appropriate group.When...

  • 660 Views
  • 3 replies
  • 0 kudos
Latest Reply
tedlo042034
New Contributor III
  • 0 kudos

@Isaac_18 Thanks for this, that makes sense. Now I believe my confusion stems from navigating the documentation. What's the difference between azure docs and aws docs? We are hosting databricks on azure, so have been navigating the azure docs, and ig...

  • 0 kudos
2 More Replies
margarita_shir
by • New Contributor III
  • 1715 Views
  • 5 replies
  • 1 kudos

Private Route53 hosted zone for cloud.databricks.com

We have Tailscale deployed on the same VPC as our Databricks workspaces. To enable PrivateLink for some workspaces, we created a private Route53 hosted zone for cloud.databricks.com with CNAME records pointing workspace hostnames to the PrivateLink e...

  • 1715 Views
  • 5 replies
  • 1 kudos
Latest Reply
suranga
Databricks Partner
  • 1 kudos

Hi @margarita_shir,I don't think this follow-up got an answer, so jumping back in. Yes, keep the Tailscale split DNS on cloud.databricks.com pointing at your VPC resolver.Here's why switching it to privatelink.cloud.databricks.com breaks things. Tail...

  • 1 kudos
4 More Replies