cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

lion_king_84
by New Contributor III
  • 1882 Views
  • 2 replies
  • 1 kudos

Resolved! Streamlit alternative

Hi all,I have a simple app that contains an editable grid and displays some graphs. The Streamlit app is slow, and end users need a faster solution. We are using sql warehouse (serverless)The app will show data of the existing delta tables and user w...

  • 1882 Views
  • 2 replies
  • 1 kudos
Latest Reply
mccuistion
Databricks Employee
  • 1 kudos

I have had good results using Dash for apps that need charts and interactive UIs. It’s a solid option if you’re moving beyond Streamlit. Why Dash works well for your use case: Charts: Plotly (built into Dash) gives you interactive charts and good ...

  • 1 kudos
1 More Replies
AlbertWang
by Valued Contributor
  • 7320 Views
  • 6 replies
  • 3 kudos

Resolved! How to create Storage Credential using Service Principal [Azure]

As the document indicates, An Azure Databricks access connector is a first-party Azure resource that lets you connect managed identities to an Azure Databricks account. You must have the Contributor role or higher on the access connector resource in ...

  • 7320 Views
  • 6 replies
  • 3 kudos
Latest Reply
ThePussCat
Databricks Partner
  • 3 kudos

Late reply.The databricks managed Access Connector is used by Databricks to manage its own "managed storage account" ( the one with the randomized characters in the name), which is used "for its own business", when spinning up and managing compute cl...

  • 3 kudos
5 More Replies
nodeb
by New Contributor III
  • 4498 Views
  • 5 replies
  • 5 kudos

Resolved! Azure Databricks Control Plane connectivity issue after migrating to vWAN

Hello everyone,Recently, I received a client request to migrate our Azure Databricks environment from a Hub-and-Spoke architecture to a vWAN Hub architecture with an NVA (Network Virtual Appliance).Here’s a quick overview of the setup:The Databricks ...

  • 4498 Views
  • 5 replies
  • 5 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 5 kudos

@nodeb Can you please mark your reply as solution. It will help other users find the resolution fast.

  • 5 kudos
4 More Replies
vamsi_simbus
by Databricks Partner
  • 1058 Views
  • 2 replies
  • 1 kudos

Resolved! Guidance Needed on Databricks Project Lifecycle & Best Practices

Hello Community,Our company is new to Databricks implementations, and we are starting our initial projects. We would like to understand the typical project lifecycle and best practices followed by experienced teams.Could you please share insights on:...

  • 1058 Views
  • 2 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Hey @vamsi_simbus , I work in the training delivery organization as a trainer.  My best advise is to create a Databricks Academy account and take the free self-paced training. Two courses in particular come to mind: DevOps Essentials for Data Enginee...

  • 1 kudos
1 More Replies
GeertS
by New Contributor II
  • 2413 Views
  • 5 replies
  • 1 kudos

Resolved! Hive Metastore - Disable Legacy Access option not found

Hi,I've just provisioned a new Databricks Workspace and I would like to enable the hive megastore for some testing. The problem is I cannot find the "Disable legacy access" setting. I went several times to Workspace Settings -> Security but it is jus...

GeertS_0-1771429510264.png
  • 2413 Views
  • 5 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Yes — that’s correct. In a new account, legacy features are disabled by design. That includes the Databricks-hosted workspace Hive metastore. You cannot enable or use Hive the way it was historically used inside a workspace. That path is closed. If y...

  • 1 kudos
4 More Replies
liraznahmias
by New Contributor
  • 731 Views
  • 1 replies
  • 0 kudos

Resolved! I would like to find my account manager

Hey,  I'm the technical manager at Playstudios, I'm trying to reach out to our account manager in Israel. she's not answering my email/messages.    Do we have a different account manager?  Please reach our to me ASAP.  Thanks,  Liraz Nahmias 

  • 731 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Community Manager
  • 0 kudos

Hello @liraznahmias!Hope the issue has been resolved and that you’ve received a response from your Account Executive.

  • 0 kudos
ricelso
by New Contributor II
  • 2919 Views
  • 4 replies
  • 3 kudos

Resolved! AWS-Databricks' workspace attached to a NCC doesn't generate Egress Stable IPs

I am facing an issue when configuring a Databricks workspace on AWS with a Network Connectivity Configuration (NCC).Even after attaching the NCC, the workspace does not generate Egress Stable IPs as expected.In the workspace configuration tab, under ...

  • 2919 Views
  • 4 replies
  • 3 kudos
Latest Reply
majidfn
New Contributor II
  • 3 kudos

Hello @Sai_Ponugoti I'm facing the exact same issue. The NCC doesn't generate the egress IPs. I'm on the premium plan, but on a trial period. I have added payment method to the account. But still the configuration shows: "Egress Stable IPs: ." Could ...

  • 3 kudos
3 More Replies
Ale_Armillotta
by Valued Contributor II
  • 1680 Views
  • 2 replies
  • 1 kudos

Resolved! Asset Bundles + GitHub Actions: why does bundle deploy re-create UC schema and volume every run?

Hi everyone,I’m working with Databricks Asset Bundles and deploying via GitHub Actions (CI/CD). I’m seeing behavior I don’t fully understand.On every pipeline run (fresh git checkout/pull and then databricks bundle deploy to the same target environme...

  • 1680 Views
  • 2 replies
  • 1 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 1 kudos

Hi @Ale_Armillotta , To answer each of your questions: Is this expected behavior for Asset Bundles Yes, deploy is declarative and will attempt “create” whenever the bundle’s tracked state doesn’t already include that resource (names aren’t used to co...

  • 1 kudos
1 More Replies
jkdatabricks
by New Contributor
  • 2672 Views
  • 4 replies
  • 0 kudos

Error: PERMISSION_DENIED: AWS IAM role does

Hello, We are trying to setup a new workspace. However we are getting following error.  Workspace failed to launch.Error: PERMISSION_DENIED: AWS IAM role does not have READ permissions on url s3://jk-databricks-prods3/unity-catalog/742920957025975.Pl...

  • 2672 Views
  • 4 replies
  • 0 kudos
Latest Reply
pradeep_singh
Honored Contributor III
  • 0 kudos

I am assuming you are creting this manually and not using terraform .Is s3://jk-databricks-prods3/unity-catalog/742920957025975 the external storage location for your UC Metastore . Can you check if the storage credential used by this external storag...

  • 0 kudos
3 More Replies
OGSN7
by New Contributor
  • 1195 Views
  • 1 replies
  • 0 kudos

Resolved! Recovery of Notebooks from Retired Community Edition Workspace

Hello,I had many notebooks in the legacy Databricks Community Edition that was retired at the end of 2025. The login link (community.cloud.databricks.com) no longer works and I cannot access my old workspace or notebooks.The automated migration banne...

  • 1195 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @OGSN7 ,Unfortunately, Databricks Community Editon has been shutdown at January 1, 2026. So there's no way to restore your content. From now on you should use Free Edition.https://community.databricks.com/t5/announcements/psa-community-edition-ret...

  • 0 kudos
dtank36
by New Contributor III
  • 1235 Views
  • 5 replies
  • 0 kudos

Resolved! App Insights Viewer Data

We would like to display some "usage" data from an App, specifically using the Insights "Viewers" data. Is that data available for us to query via system tables or access via API, or only via the UI?

  • 1235 Views
  • 5 replies
  • 0 kudos
Latest Reply
dtank36
New Contributor III
  • 0 kudos

Hi @sarahbhord,Thanks for the response I did try those queries without any luck. I was hoping the User Authorization Actions example would work, but it doesn't return any results. We are using the preview feature Databricks Apps - On-Behalf-Of User A...

  • 0 kudos
4 More Replies
tinodj
by Databricks Partner
  • 1550 Views
  • 6 replies
  • 1 kudos

Real-time output missing when using “Upload and Run File” from VS Code

I am running Python files on a Databricks cluster using the VS Code Databricks extension, specifically the “Upload and Run File” command.I cannot get real-time output in the Debug Console. I have checked the official docs:https://learn.microsoft.com/...

  • 1550 Views
  • 6 replies
  • 1 kudos
Latest Reply
tinodj
Databricks Partner
  • 1 kudos

@Dali1 I have even tried to describe  https://github.com/databricks/databricks-vscode/issues/1813  and to fix on https://github.com/databricks/databricks-vscode/pull/1814, unfortunately no one seems to be interested in this. 

  • 1 kudos
5 More Replies
mlrichmond-mill
by New Contributor III
  • 853 Views
  • 3 replies
  • 0 kudos

Serverless Compute with HITRUST Compliance

After doing some prototyping work in a databricks environment that we threw together quickly, I am now creating a new environment for a more refined development environment. Since we work with some limited PII in my industry, I was erring on the safe...

  • 853 Views
  • 3 replies
  • 0 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 0 kudos

I think this is expected today. Serverless on HITRUST was expected in Jan 2026 but I think it slipped to end-Feb. Lots of moving parts between Databricks and MSFT for this to happen. Which region are you in?

  • 0 kudos
2 More Replies
rvm1975
by New Contributor III
  • 1008 Views
  • 2 replies
  • 2 kudos

Resolved! Deploy app using bundle asset

It is easy to deploy app as part of asset bundle resources. But after that you need to actually deploy app and start.Can we do app deploy in databricks.yml / resources as part of initial "bundle deploy"? I mean avoid separate run ofdatabricks apps de...

  • 1008 Views
  • 2 replies
  • 2 kudos
Latest Reply
shazi
New Contributor III
  • 2 kudos

Deploying an app via bundle resources in Databricks is like a Morse code decoder—both aim to streamline signals into one unified step instead of requiring separate runs.

  • 2 kudos
1 More Replies
lion_king_84
by New Contributor III
  • 4055 Views
  • 10 replies
  • 0 kudos

Resolved! Databricks Asset Bundles Deploy Apps

Hello,I checked bundle app example in Github. https://github.com/databricks/bundle-examples/blob/main/knowledge_base/app_with_database/resources/myapp.app.ymlThen, I deployed a streamlit app via Databricks Asset Bundles. Then I opened the related app...

lion_king_84_0-1770882935941.png
  • 4055 Views
  • 10 replies
  • 0 kudos
Latest Reply
sarahbhord
Databricks Employee
  • 0 kudos

I looked further - the databricks.yml file is not used in this UI-based workflow - it's only for CLI deployments. Your app configuration therefore comes from selecting options in the UI. I believe that is why the code is never getting deployed here.T...

  • 0 kudos
9 More Replies