cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Fortinbras
by New Contributor II
  • 255 Views
  • 0 replies
  • 0 kudos

Databricks App architecture with AppKit - agentic app with governed write-back functionality

Hi Everyone,I am currently working on an internal application for editing and analyzing forecast data built and hosted via Databricks Apps. I would appreciate a sanity check from anyone who has taken AppKit into production as I am planning on utilizi...

  • 255 Views
  • 0 replies
  • 0 kudos
kfadratek
by New Contributor
  • 300 Views
  • 1 replies
  • 0 kudos

Azure Databricks Default Package Repository with Azure Key Vault-backed Secret Scope

Hi,I’m trying to configure Default Python Package Repository in an Azure Databricks workspace and would like to clarify whether the predefined secret scope can be backed by Azure Key Vault.According to the documentation, Default Package Repository ca...

  • 300 Views
  • 1 replies
  • 0 kudos
Latest Reply
ShamenParis
Contributor III
  • 0 kudos

Hi @kfadratek ,Yes, an Azure Key Vault (AKV) backed scope will work, but Databricks has to resolve it automatically in the background.The UI is built to write secrets. Since AKV scopes are read-only from the Databricks side, the UI won't let you map ...

  • 0 kudos
en-purple-wheel
by New Contributor II
  • 533 Views
  • 1 replies
  • 1 kudos

Unity Catalog in Microsoft Azure Government

I found this article from 2025 talking about it being in the works: https://www.databricks.com/blog/databricks-partners-microsoft-bring-our-data-intelligence-platform-azure-governmentDoes anyone know if it is yet available in MAG?

  • 533 Views
  • 1 replies
  • 1 kudos
Latest Reply
suryaprayaga
Contributor
  • 1 kudos

Currently according to the Microsoft's documentation Azure Databricks supports dedicated government regions such as usgovaz and usgovva.Azure Government hosts several government workloads with tight-knit security protocols and network groups. One int...

  • 1 kudos
MrDecisive
by New Contributor III
  • 889 Views
  • 4 replies
  • 9 kudos

Resolved! Mono Repo or not Mono Repo - that is the question?

Hi All,We are just getting started with a Databricks on Azure Proof of Concept platform. Right now we are thinking about the deployment of workloads using data bundles driven by GitHub Action workflows. The documents recommend using a single repo for...

  • 889 Views
  • 4 replies
  • 9 kudos
Latest Reply
MrDecisive
New Contributor III
  • 9 kudos

Thanks for all the replies so far - definitely food for thought. I think as this is a POC we will probably go with the mono repo for easy of deployment with the view that as we learn more about our potential customer landscape we can always pivot to ...

  • 9 kudos
3 More Replies
NelsonE
by New Contributor III
  • 3497 Views
  • 4 replies
  • 1 kudos

Terraform Failed to get oauth access token. Please retry after logout and login again. with GCP

Hi I'm having trouble creating a databricks_mws_vpc_endpoint with Terraform.I already created 2 Private Service Connect (PSC) and I'm trying to create the vpc endpoint for Databricks but I'm getting this error:BAD_REQUEST: Failed to get oauth access ...

  • 3497 Views
  • 4 replies
  • 1 kudos
Latest Reply
andres_garcia
Databricks Employee
  • 1 kudos

On Google Cloud Platform (GCP), the account-level Databricks Terraform Provider or account API does not use standard Databricks tokens or standard Databricks OAuth. Instead, it relies on Google Cloud ID (OIDC) tokens generated via a Google Cloud serv...

  • 1 kudos
3 More Replies
b_pinter
by Databricks Partner
  • 1888 Views
  • 6 replies
  • 3 kudos

Resolved! NetSuite JDBC Driver 8.10.184.0 Suppor

Hello,I am currently attempting to integrate NetSuite with Databricks using the NetSuite JDBC driver version 8.10.184.0. When I attempt to ingestion information from NetSuite to Databricks, I find that the job fails with a checksum error and informs ...

  • 1888 Views
  • 6 replies
  • 3 kudos
Latest Reply
tcranoratmcgee
New Contributor II
  • 3 kudos

Thanks!I really wasn't hopeful about Netsuite sharing an older version with us but after escalating a support ticket, we were able to get it.

  • 3 kudos
5 More Replies
charl-p-botha
by Databricks Partner
  • 2286 Views
  • 6 replies
  • 4 kudos

How to limit the AI/BI dashboard sharing people-picker to workspace members

Dear community,We follow the environment-isolation guidance in [1], relying on between-workspace and within-workspace separation (Unity Catalog, catalog-workspace bindings, ACLs). In our case we have different groups of users each assigned to their o...

  • 2286 Views
  • 6 replies
  • 4 kudos
Latest Reply
Syntera
New Contributor II
  • 4 kudos

I have been raising the exact same concerns when we noticed these and other changes in how Databricks handles access and sharing. The lack of control options when new features are rolled out is not very customer oriented, especially since they are us...

  • 4 kudos
5 More Replies
RamenBhar
by New Contributor III
  • 1182 Views
  • 5 replies
  • 5 kudos

Resolved! Can I connect Fabric Data Agent With Databricks Genie One as external connection

HiI have a fabric semantic model. I have created a fabric data agent (published) on top of the semantic model. Now i have created a unity catalog connection along with service. Is MCP connection is true. I can use this connection in AI playground or ...

RamenBhar_0-1785158729196.png
  • 1182 Views
  • 5 replies
  • 5 kudos
Latest Reply
RamenBhar
New Contributor III
  • 5 kudos

Hi @Lu_Wang_ENB_DBX  - Apologies I forgot to mentioned that I have managed to solve this.Issue:I was creating service (MCP Service) under schema. This also creating MCP connection where "is_mcp_connection=true". This connection was not visible in the...

  • 5 kudos
4 More Replies
Raman_Unifeye
by Honored Contributor III
  • 3634 Views
  • 7 replies
  • 2 kudos

How to restrict Databricks Apps and Vector Search endpoint creation for workspace users

I am looking to restrict all workspace users' access to create Databricks Apps and Vector Search endpoints.I am aware there is no simple toggle, what is the best way to implement it?

  • 3634 Views
  • 7 replies
  • 2 kudos
Latest Reply
VitorAvancini
New Contributor III
  • 2 kudos

Is this something databricks is planning to add? seems like a simple and very important feature for governance

  • 2 kudos
6 More Replies
ShivannaGundana
by New Contributor II
  • 526 Views
  • 2 replies
  • 1 kudos

Databricks AWS Worker Nodes Not Registering with AWS Systems Manager (SSM)

Hi Team,We are investigating an issue where Databricks worker instances running on AWS are not registering with AWS Systems Manager (SSM).EnvironmentDatabricks Runtime: 17.3 LTSWorker OS: Ubuntu 24.04AWS EC2 worker instances launched by DatabricksIAM...

  • 526 Views
  • 2 replies
  • 1 kudos
Latest Reply
alexjames3123
New Contributor II
  • 1 kudos

@ShivannaGundana wrote:This is a helpful troubleshooting discussion for teams working with Databricks and AWS environments. Checking IAM permissions, network connectivity, and instance configuration are important steps when diagnosing SSM registratio...

  • 1 kudos
1 More Replies
LokeshChikuru
by Databricks Partner
  • 2707 Views
  • 3 replies
  • 1 kudos

VNet Data Gateway unable to connect to Azure Databricks Serverless SQL via Private Endpoint

I’m facing connectivity issues when trying to connect Microsoft Fabric / Power BI to Azure Databricks Serverless and PRO SQL Warehouse using a VNet Data Gateway. I’m looking for guidance on whether this scenario is supported or if there are known lim...

  • 2707 Views
  • 3 replies
  • 1 kudos
Latest Reply
LokeshChikuru
Databricks Partner
  • 1 kudos

This resolved after Azure Storage Service endpoint attached to the Vnet-Data Gateway subnet, then the Fabrics refresh was able to process the data.

  • 1 kudos
2 More Replies
Prasad329
by New Contributor II
  • 6602 Views
  • 3 replies
  • 2 kudos

Automating Version Control for Databricks Workflows

I am currently using Databricks Asset Bundles to manage and deploy workflows. While I have successfully automated the version control for notebooks, I am facing challenges with workflows. Specifically, I am looking to automate the process of fetching...

  • 6602 Views
  • 3 replies
  • 2 kudos
Latest Reply
renbud
New Contributor II
  • 2 kudos

I am facing the same issue as Prasad329.The recommended best practice is "*Always make changes in the GitHub-managed YAML (bundle)*". In my opinion this only makes sense if a good editor is provided for the source artifacts.For python there are good ...

  • 2 kudos
2 More Replies
connieyang
by Databricks Employee
  • 303 Views
  • 0 replies
  • 1 kudos

Participate in a Databricks user study!

Hi Databricks Community, I'm Connie from the Databricks UX research team!We are conducting a user study to understand how admins identify, investigate, and resolve governance issues in their Databricks environments. We'd love to connect with individ...

  • 303 Views
  • 0 replies
  • 1 kudos
APJESK
by Contributor
  • 1363 Views
  • 4 replies
  • 2 kudos

Enterprise-level Unity Catalog governance

Hi everyoneI'm currently designing an enterprise-level Unity Catalog governance model for Databricks and would like to learn from others who have implemented it in production.I'm trying to understand what personas are actually required at each level,...

  • 1363 Views
  • 4 replies
  • 2 kudos
Latest Reply
emma_s
Databricks Employee
  • 2 kudos

@APJESK, the existing replies from @balajij8 and @binlogreader cover the practical patterns well, in answer to your questions. But generally your design looks good with a few tweaks.   1. Single Terraform SP as Metastore Admin for provisioning - yes,...

  • 2 kudos
3 More Replies
alpines
by New Contributor II
  • 902 Views
  • 1 replies
  • 1 kudos

Resolved! Deactive Admin user

Hi Community,I have a Databricks account and workspaces that were previously setup by a user who is no longer with our company and I am attempting to remove admin access and deactive the user account. However as an Account admin user myself, when I a...

  • 902 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @alpines ,This error typically occurs when attempting to remove the 'account owner.' The account owner is the user who originally set up the Databricks account. This entitlement is attached to a user so that there is always at least one account ad...

  • 1 kudos