cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

andrefilipemm
by • New Contributor
  • 2942 Views
  • 1 replies
  • 0 kudos

Automatic Identity Management

Hello,In the context of reviewing our company's databricks structure and migrating legacy workspaces to Unity Catalog enabled ones, we're stuck with a few questions regarding enabling the automatic identity management feature.We currently provision D...

  • 2942 Views
  • 1 replies
  • 0 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 0 kudos

Hi @andrefilipemm, These are important questions when planning a migration to identity federation and Unity Catalog. Let me address each one. BACKGROUND: HOW IDENTITY FEDERATION WORKS When you enable identity federation on a workspace, identity manag...

  • 0 kudos
APJESK
by • Contributor
  • 2566 Views
  • 2 replies
  • 1 kudos

Implement & Test DR Plan in AWS databricks

Can you share detailed steps or document for DR setup.Example Consider Workspace A running in us-east-1, and planning to setup DR on us-west-2So what are the steps and Task I need to create on AWS us-west-2.Please share in detail steps that required ...

  • 2566 Views
  • 2 replies
  • 1 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 1 kudos

@APJESK I have seen this pattern before. disaster recovery planning for Databricks on AWS is a critical topic and one that Databricks has solid documentation and tooling around. Let me walk you through a comprehensive approach to implementing and tes...

  • 1 kudos
1 More Replies
bdocken
by • New Contributor II
  • 2290 Views
  • 7 replies
  • 3 kudos

Non-admin users hit browser error opening Jobs → [Job] → Tasks tab (admins OK)

Hi Databricks Community,We’re seeing what appears to be a Jobs UI bug affecting non-admin users only.SummaryWhen a non-admin user opens a job and clicks the Tasks tab, the UI fails and shows an error modal. Admin users can access the same job’s Tasks...

  • 2290 Views
  • 7 replies
  • 3 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 3 kudos

Hi @bdocken, Great that the product team will be looking at your workspace directly -- that is the fastest path to a definitive fix for the redirect loop and React error #185 you are seeing. While you wait for that investigation to complete, here are...

  • 3 kudos
6 More Replies
discuss_darende
by • New Contributor III
  • 3125 Views
  • 4 replies
  • 0 kudos

Unable to add users to Azure AD–synced Databricks group via SCIM (InternalError)

Hi everyone,I’m trying to add users to an existing Databricks group programmatically using the Databricks SDK (SCIM PATCH), but I consistently hit an internal error and can’t tell if this is expected behavior or a limitation.My main goal is adding us...

  • 3125 Views
  • 4 replies
  • 0 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 0 kudos

Hi @discuss_darende, @KartikBhatnagar is on the right track in the replies above. Let me expand on this with the full picture. The "InternalError" you are seeing when trying to add users to an Azure AD-synced group via SCIM is expected behavior. Grou...

  • 0 kudos
3 More Replies
emanueol
by • New Contributor III
  • 4580 Views
  • 3 replies
  • 0 kudos

How setup jdbc connection to snowflake

Hi, im on free Databricks tier account and need help understanding how create jdbc connection to snowflake, as I'm getting error:Catalog > (+) > Create a connection:  Connection name= jdbc_snowflake  Connection type= JDBC  [next]    Url= jdbc//org-ac...

Screenshot_20260207-115541.png Screenshot_20260207-115657-display-0.png.png Screenshot_20260207-115728-display-0.png.png Screenshot_20260207-115805-display-0.png.png
  • 4580 Views
  • 3 replies
  • 0 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 0 kudos

Hi @emanueol, The error you are seeing ("Connection type JDBC requires environment settings") is because you selected "JDBC" as the connection type, which is a generic connector intended for databases that do not have a dedicated connection type in D...

  • 0 kudos
2 More Replies
vino2000
by • New Contributor
  • 1463 Views
  • 1 replies
  • 0 kudos

Payment with Netsuite Customer Payment Portal

I was using a trial account and credit was finished. Now i have done my first month and my card has been rejected,At the moment I received a warning email where i should pay at this platform named as Netsuite Customer Payment Portal but I can't login...

  • 1463 Views
  • 1 replies
  • 0 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 0 kudos

Hi @vino2000, Thanks for reaching out. I understand the frustration -- your trial credits ran out, your card was declined, and now you have received an email pointing you to the NetSuite Customer Payment Portal but you cannot log in or reset your pas...

  • 0 kudos
mat723
by • New Contributor II
  • 3727 Views
  • 3 replies
  • 1 kudos

External connectivity to VNET Injected & SCC enabled workspace

Hi All,We have a Databricks installation that is in our internal azure vnets (using vnet injection). And secure cluster connectivity is enabled as well. We have couple of external partners who wants to connect to our workspaces using APIs and JDBC. W...

  • 3727 Views
  • 3 replies
  • 1 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 1 kudos

Hi mat723, That approach is sound and is actually a fairly common pattern. Standing up a public-facing proxy/gateway that is locked down to only the partner's IP ranges, with the backend connecting to the Databricks workspace over Private Link, gives...

  • 1 kudos
2 More Replies
odrobek
by • Databricks Partner
  • 5965 Views
  • 6 replies
  • 4 kudos

Resolved! Databricks Apps Processes and Pain Points

I'm really interested in learning the processes of the creation and use of Databricks Apps in production that people are using right now. Anybody who has done so, I'd love it if you could provide info on what some of your pain points during these pro...

  • 5965 Views
  • 6 replies
  • 4 kudos
Latest Reply
SteveOstrowski
Databricks Employee
  • 4 kudos

Hi @odrobek, Great question -- Databricks Apps is still maturing, and sharing real-world workflows helps everyone. I have been working with Apps across several projects, so here is a rundown of what the production development cycle typically looks li...

  • 4 kudos
5 More Replies
lion_king_84
by • New Contributor III
  • 2672 Views
  • 2 replies
  • 1 kudos

Resolved! Streamlit alternative

Hi all,I have a simple app that contains an editable grid and displays some graphs. The Streamlit app is slow, and end users need a faster solution. We are using sql warehouse (serverless)The app will show data of the existing delta tables and user w...

  • 2672 Views
  • 2 replies
  • 1 kudos
Latest Reply
mccuistion
Databricks Employee
  • 1 kudos

I have had good results using Dash for apps that need charts and interactive UIs. It’s a solid option if you’re moving beyond Streamlit. Why Dash works well for your use case: Charts: Plotly (built into Dash) gives you interactive charts and good ...

  • 1 kudos
1 More Replies
AlbertWang
by • Valued Contributor
  • 8538 Views
  • 6 replies
  • 3 kudos

Resolved! How to create Storage Credential using Service Principal [Azure]

As the document indicates, An Azure Databricks access connector is a first-party Azure resource that lets you connect managed identities to an Azure Databricks account. You must have the Contributor role or higher on the access connector resource in ...

  • 8538 Views
  • 6 replies
  • 3 kudos
Latest Reply
ThePussCat
Databricks Partner
  • 3 kudos

Late reply.The databricks managed Access Connector is used by Databricks to manage its own "managed storage account" ( the one with the randomized characters in the name), which is used "for its own business", when spinning up and managing compute cl...

  • 3 kudos
5 More Replies
nodeb
by • New Contributor III
  • 5363 Views
  • 5 replies
  • 5 kudos

Resolved! Azure Databricks Control Plane connectivity issue after migrating to vWAN

Hello everyone,Recently, I received a client request to migrate our Azure Databricks environment from a Hub-and-Spoke architecture to a vWAN Hub architecture with an NVA (Network Virtual Appliance).Here’s a quick overview of the setup:The Databricks ...

  • 5363 Views
  • 5 replies
  • 5 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 5 kudos

@nodeb Can you please mark your reply as solution. It will help other users find the resolution fast.

  • 5 kudos
4 More Replies
vamsi_simbus
by • Databricks Partner
  • 1426 Views
  • 2 replies
  • 1 kudos

Resolved! Guidance Needed on Databricks Project Lifecycle & Best Practices

Hello Community,Our company is new to Databricks implementations, and we are starting our initial projects. We would like to understand the typical project lifecycle and best practices followed by experienced teams.Could you please share insights on:...

  • 1426 Views
  • 2 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Hey @vamsi_simbus , I work in the training delivery organization as a trainer.  My best advise is to create a Databricks Academy account and take the free self-paced training. Two courses in particular come to mind: DevOps Essentials for Data Enginee...

  • 1 kudos
1 More Replies
GeertS
by • New Contributor II
  • 3196 Views
  • 5 replies
  • 1 kudos

Resolved! Hive Metastore - Disable Legacy Access option not found

Hi,I've just provisioned a new Databricks Workspace and I would like to enable the hive megastore for some testing. The problem is I cannot find the "Disable legacy access" setting. I went several times to Workspace Settings -> Security but it is jus...

GeertS_0-1771429510264.png
  • 3196 Views
  • 5 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Yes — that’s correct. In a new account, legacy features are disabled by design. That includes the Databricks-hosted workspace Hive metastore. You cannot enable or use Hive the way it was historically used inside a workspace. That path is closed. If y...

  • 1 kudos
4 More Replies
liraznahmias
by • New Contributor
  • 861 Views
  • 1 replies
  • 0 kudos

Resolved! I would like to find my account manager

Hey,  I'm the technical manager at Playstudios, I'm trying to reach out to our account manager in Israel. she's not answering my email/messages.    Do we have a different account manager?  Please reach our to me ASAP.  Thanks,  Liraz Nahmias 

  • 861 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Community Manager
  • 0 kudos

Hello @liraznahmias!Hope the issue has been resolved and that you’ve received a response from your Account Executive.

  • 0 kudos
ricelso
by • New Contributor II
  • 3517 Views
  • 4 replies
  • 3 kudos

Resolved! AWS-Databricks' workspace attached to a NCC doesn't generate Egress Stable IPs

I am facing an issue when configuring a Databricks workspace on AWS with a Network Connectivity Configuration (NCC).Even after attaching the NCC, the workspace does not generate Egress Stable IPs as expected.In the workspace configuration tab, under ...

  • 3517 Views
  • 4 replies
  • 3 kudos
Latest Reply
majidfn
New Contributor II
  • 3 kudos

Hello @Sai_Ponugoti I'm facing the exact same issue. The NCC doesn't generate the egress IPs. I'm on the premium plan, but on a trial period. I have added payment method to the account. But still the configuration shows: "Egress Stable IPs: ." Could ...

  • 3 kudos
3 More Replies