cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

PNC
by Databricks Partner
  • 1322 Views
  • 2 replies
  • 1 kudos

Using Terraform to GRANT SELECT ON ANY FILE securable

I have a use case where service principals will read .csv files from Azure Storage Account and create views from them. This used to work in our legacy environment but we are currently migrating to Unity Catalog and when we tested our existing jobs we...

  • 1322 Views
  • 2 replies
  • 1 kudos
Latest Reply
ThePussCat
Databricks Partner
  • 1 kudos

How about... (not tried it myself)resource "databricks_sql_permissions" "grant_select_any_file" {any_file = true privilege_assignments { principal = "your-role" privileges = ["SELECT"] }}

  • 1 kudos
1 More Replies
nodeb
by New Contributor III
  • 3635 Views
  • 5 replies
  • 5 kudos

Resolved! Azure Databricks Control Plane connectivity issue after migrating to vWAN

Hello everyone,Recently, I received a client request to migrate our Azure Databricks environment from a Hub-and-Spoke architecture to a vWAN Hub architecture with an NVA (Network Virtual Appliance).Here’s a quick overview of the setup:The Databricks ...

  • 3635 Views
  • 5 replies
  • 5 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 5 kudos

@nodeb Can you please mark your reply as solution. It will help other users find the resolution fast.

  • 5 kudos
4 More Replies
vamsi_simbus
by Databricks Partner
  • 654 Views
  • 2 replies
  • 1 kudos

Resolved! Guidance Needed on Databricks Project Lifecycle & Best Practices

Hello Community,Our company is new to Databricks implementations, and we are starting our initial projects. We would like to understand the typical project lifecycle and best practices followed by experienced teams.Could you please share insights on:...

  • 654 Views
  • 2 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Hey @vamsi_simbus , I work in the training delivery organization as a trainer.  My best advise is to create a Databricks Academy account and take the free self-paced training. Two courses in particular come to mind: DevOps Essentials for Data Enginee...

  • 1 kudos
1 More Replies
GeertS
by New Contributor II
  • 1225 Views
  • 5 replies
  • 1 kudos

Resolved! Hive Metastore - Disable Legacy Access option not found

Hi,I've just provisioned a new Databricks Workspace and I would like to enable the hive megastore for some testing. The problem is I cannot find the "Disable legacy access" setting. I went several times to Workspace Settings -> Security but it is jus...

GeertS_0-1771429510264.png
  • 1225 Views
  • 5 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Yes — that’s correct. In a new account, legacy features are disabled by design. That includes the Databricks-hosted workspace Hive metastore. You cannot enable or use Hive the way it was historically used inside a workspace. That path is closed. If y...

  • 1 kudos
4 More Replies
liraznahmias
by New Contributor
  • 516 Views
  • 1 replies
  • 0 kudos

Resolved! I would like to find my account manager

Hey,  I'm the technical manager at Playstudios, I'm trying to reach out to our account manager in Israel. she's not answering my email/messages.    Do we have a different account manager?  Please reach our to me ASAP.  Thanks,  Liraz Nahmias 

  • 516 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Community Manager
  • 0 kudos

Hello @liraznahmias!Hope the issue has been resolved and that you’ve received a response from your Account Executive.

  • 0 kudos
ricelso
by New Contributor II
  • 2476 Views
  • 4 replies
  • 3 kudos

Resolved! AWS-Databricks' workspace attached to a NCC doesn't generate Egress Stable IPs

I am facing an issue when configuring a Databricks workspace on AWS with a Network Connectivity Configuration (NCC).Even after attaching the NCC, the workspace does not generate Egress Stable IPs as expected.In the workspace configuration tab, under ...

  • 2476 Views
  • 4 replies
  • 3 kudos
Latest Reply
majidfn
New Contributor II
  • 3 kudos

Hello @Sai_Ponugoti I'm facing the exact same issue. The NCC doesn't generate the egress IPs. I'm on the premium plan, but on a trial period. I have added payment method to the account. But still the configuration shows: "Egress Stable IPs: ." Could ...

  • 3 kudos
3 More Replies
Ale_Armillotta
by Valued Contributor II
  • 943 Views
  • 2 replies
  • 1 kudos

Resolved! Asset Bundles + GitHub Actions: why does bundle deploy re-create UC schema and volume every run?

Hi everyone,I’m working with Databricks Asset Bundles and deploying via GitHub Actions (CI/CD). I’m seeing behavior I don’t fully understand.On every pipeline run (fresh git checkout/pull and then databricks bundle deploy to the same target environme...

  • 943 Views
  • 2 replies
  • 1 kudos
Latest Reply
stbjelcevic
Databricks Employee
  • 1 kudos

Hi @Ale_Armillotta , To answer each of your questions: Is this expected behavior for Asset Bundles Yes, deploy is declarative and will attempt “create” whenever the bundle’s tracked state doesn’t already include that resource (names aren’t used to co...

  • 1 kudos
1 More Replies
jkdatabricks
by New Contributor
  • 2452 Views
  • 4 replies
  • 0 kudos

Error: PERMISSION_DENIED: AWS IAM role does

Hello, We are trying to setup a new workspace. However we are getting following error.  Workspace failed to launch.Error: PERMISSION_DENIED: AWS IAM role does not have READ permissions on url s3://jk-databricks-prods3/unity-catalog/742920957025975.Pl...

  • 2452 Views
  • 4 replies
  • 0 kudos
Latest Reply
pradeep_singh
Contributor III
  • 0 kudos

I am assuming you are creting this manually and not using terraform .Is s3://jk-databricks-prods3/unity-catalog/742920957025975 the external storage location for your UC Metastore . Can you check if the storage credential used by this external storag...

  • 0 kudos
3 More Replies
OGSN7
by New Contributor
  • 702 Views
  • 1 replies
  • 0 kudos

Resolved! Recovery of Notebooks from Retired Community Edition Workspace

Hello,I had many notebooks in the legacy Databricks Community Edition that was retired at the end of 2025. The login link (community.cloud.databricks.com) no longer works and I cannot access my old workspace or notebooks.The automated migration banne...

  • 702 Views
  • 1 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @OGSN7 ,Unfortunately, Databricks Community Editon has been shutdown at January 1, 2026. So there's no way to restore your content. From now on you should use Free Edition.https://community.databricks.com/t5/announcements/psa-community-edition-ret...

  • 0 kudos
dtank36
by New Contributor III
  • 896 Views
  • 5 replies
  • 0 kudos

Resolved! App Insights Viewer Data

We would like to display some "usage" data from an App, specifically using the Insights "Viewers" data. Is that data available for us to query via system tables or access via API, or only via the UI?

  • 896 Views
  • 5 replies
  • 0 kudos
Latest Reply
dtank36
New Contributor III
  • 0 kudos

Hi @sarahbhord,Thanks for the response I did try those queries without any luck. I was hoping the User Authorization Actions example would work, but it doesn't return any results. We are using the preview feature Databricks Apps - On-Behalf-Of User A...

  • 0 kudos
4 More Replies
tinodj
by Databricks Partner
  • 1230 Views
  • 6 replies
  • 1 kudos

Real-time output missing when using “Upload and Run File” from VS Code

I am running Python files on a Databricks cluster using the VS Code Databricks extension, specifically the “Upload and Run File” command.I cannot get real-time output in the Debug Console. I have checked the official docs:https://learn.microsoft.com/...

  • 1230 Views
  • 6 replies
  • 1 kudos
Latest Reply
tinodj
Databricks Partner
  • 1 kudos

@Dali1 I have even tried to describe  https://github.com/databricks/databricks-vscode/issues/1813  and to fix on https://github.com/databricks/databricks-vscode/pull/1814, unfortunately no one seems to be interested in this. 

  • 1 kudos
5 More Replies
mlrichmond-mill
by New Contributor III
  • 617 Views
  • 3 replies
  • 0 kudos

Serverless Compute with HITRUST Compliance

After doing some prototyping work in a databricks environment that we threw together quickly, I am now creating a new environment for a more refined development environment. Since we work with some limited PII in my industry, I was erring on the safe...

  • 617 Views
  • 3 replies
  • 0 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 0 kudos

I think this is expected today. Serverless on HITRUST was expected in Jan 2026 but I think it slipped to end-Feb. Lots of moving parts between Databricks and MSFT for this to happen. Which region are you in?

  • 0 kudos
2 More Replies
rvm1975
by New Contributor II
  • 668 Views
  • 2 replies
  • 2 kudos

Resolved! Deploy app using bundle asset

It is easy to deploy app as part of asset bundle resources. But after that you need to actually deploy app and start.Can we do app deploy in databricks.yml / resources as part of initial "bundle deploy"? I mean avoid separate run ofdatabricks apps de...

  • 668 Views
  • 2 replies
  • 2 kudos
Latest Reply
shazi
New Contributor III
  • 2 kudos

Deploying an app via bundle resources in Databricks is like a Morse code decoder—both aim to streamline signals into one unified step instead of requiring separate runs.

  • 2 kudos
1 More Replies
lion_king_84
by New Contributor III
  • 2460 Views
  • 10 replies
  • 0 kudos

Resolved! Databricks Asset Bundles Deploy Apps

Hello,I checked bundle app example in Github. https://github.com/databricks/bundle-examples/blob/main/knowledge_base/app_with_database/resources/myapp.app.ymlThen, I deployed a streamlit app via Databricks Asset Bundles. Then I opened the related app...

lion_king_84_0-1770882935941.png
  • 2460 Views
  • 10 replies
  • 0 kudos
Latest Reply
sarahbhord
Databricks Employee
  • 0 kudos

I looked further - the databricks.yml file is not used in this UI-based workflow - it's only for CLI deployments. Your app configuration therefore comes from selecting options in the UI. I believe that is why the code is never getting deployed here.T...

  • 0 kudos
9 More Replies
Fabi_DYM
by Databricks Partner
  • 1066 Views
  • 3 replies
  • 1 kudos

Resolved! Error creating Git folder: Invalid Git provider credential although PAT is valid and cloning works o

Hi everyone,I’m getting this error when trying to create a Git folder in Databricks:Error creating Git folderInvalid Git provider credential for repository with URL [Placeholder]. How to fixPlease go to your remote Git provider to ensure that:You hav...

  • 1066 Views
  • 3 replies
  • 1 kudos
Latest Reply
saurabh18cs
Honored Contributor III
  • 1 kudos

how are you doing it manually ? or during job deployment or during job execution? your own identity or servie principal identity?

  • 1 kudos
2 More Replies