cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

en-purple-wheel
by New Contributor
  • 273 Views
  • 1 replies
  • 1 kudos

Unity Catalog in Microsoft Azure Government

I found this article from 2025 talking about it being in the works: https://www.databricks.com/blog/databricks-partners-microsoft-bring-our-data-intelligence-platform-azure-governmentDoes anyone know if it is yet available in MAG?

  • 273 Views
  • 1 replies
  • 1 kudos
Latest Reply
suryaprayaga
New Contributor II
  • 1 kudos

Currently according to the Microsoft's documentation Azure Databricks supports dedicated government regions such as usgovaz and usgovva.Azure Government hosts several government workloads with tight-knit security protocols and network groups. One int...

  • 1 kudos
MrDecisive
by New Contributor
  • 361 Views
  • 4 replies
  • 9 kudos

Resolved! Mono Repo or not Mono Repo - that is the question?

Hi All,We are just getting started with a Databricks on Azure Proof of Concept platform. Right now we are thinking about the deployment of workloads using data bundles driven by GitHub Action workflows. The documents recommend using a single repo for...

  • 361 Views
  • 4 replies
  • 9 kudos
Latest Reply
MrDecisive
New Contributor
  • 9 kudos

Thanks for all the replies so far - definitely food for thought. I think as this is a POC we will probably go with the mono repo for easy of deployment with the view that as we learn more about our potential customer landscape we can always pivot to ...

  • 9 kudos
3 More Replies
NelsonE
by New Contributor III
  • 3339 Views
  • 4 replies
  • 1 kudos

Terraform Failed to get oauth access token. Please retry after logout and login again. with GCP

Hi I'm having trouble creating a databricks_mws_vpc_endpoint with Terraform.I already created 2 Private Service Connect (PSC) and I'm trying to create the vpc endpoint for Databricks but I'm getting this error:BAD_REQUEST: Failed to get oauth access ...

  • 3339 Views
  • 4 replies
  • 1 kudos
Latest Reply
andres_garcia
Databricks Employee
  • 1 kudos

On Google Cloud Platform (GCP), the account-level Databricks Terraform Provider or account API does not use standard Databricks tokens or standard Databricks OAuth. Instead, it relies on Google Cloud ID (OIDC) tokens generated via a Google Cloud serv...

  • 1 kudos
3 More Replies
b_pinter
by Databricks Partner
  • 1615 Views
  • 6 replies
  • 3 kudos

Resolved! NetSuite JDBC Driver 8.10.184.0 Suppor

Hello,I am currently attempting to integrate NetSuite with Databricks using the NetSuite JDBC driver version 8.10.184.0. When I attempt to ingestion information from NetSuite to Databricks, I find that the job fails with a checksum error and informs ...

  • 1615 Views
  • 6 replies
  • 3 kudos
Latest Reply
tcranoratmcgee
New Contributor II
  • 3 kudos

Thanks!I really wasn't hopeful about Netsuite sharing an older version with us but after escalating a support ticket, we were able to get it.

  • 3 kudos
5 More Replies
charl-p-botha
by Databricks Partner
  • 1122 Views
  • 6 replies
  • 4 kudos

How to limit the AI/BI dashboard sharing people-picker to workspace members

Dear community,We follow the environment-isolation guidance in [1], relying on between-workspace and within-workspace separation (Unity Catalog, catalog-workspace bindings, ACLs). In our case we have different groups of users each assigned to their o...

  • 1122 Views
  • 6 replies
  • 4 kudos
Latest Reply
Syntera
New Contributor II
  • 4 kudos

I have been raising the exact same concerns when we noticed these and other changes in how Databricks handles access and sharing. The lack of control options when new features are rolled out is not very customer oriented, especially since they are us...

  • 4 kudos
5 More Replies
RamenBhar
by New Contributor III
  • 594 Views
  • 5 replies
  • 5 kudos

Resolved! Can I connect Fabric Data Agent With Databricks Genie One as external connection

HiI have a fabric semantic model. I have created a fabric data agent (published) on top of the semantic model. Now i have created a unity catalog connection along with service. Is MCP connection is true. I can use this connection in AI playground or ...

RamenBhar_0-1785158729196.png
  • 594 Views
  • 5 replies
  • 5 kudos
Latest Reply
RamenBhar
New Contributor III
  • 5 kudos

Hi @Lu_Wang_ENB_DBX  - Apologies I forgot to mentioned that I have managed to solve this.Issue:I was creating service (MCP Service) under schema. This also creating MCP connection where "is_mcp_connection=true". This connection was not visible in the...

  • 5 kudos
4 More Replies
Darshanrawal971
by New Contributor
  • 257 Views
  • 2 replies
  • 0 kudos

How is Serverless Compute implemented under the hood?

Hi everyone,I've been reading about Serverless Compute and have a question about the underlying architecture.In the classic compute model, clusters are provisioned in the customer's cloud account. With Serverless, Databricks manages the compute, but ...

  • 257 Views
  • 2 replies
  • 0 kudos
Latest Reply
ShamenParis
Contributor
  • 0 kudos

Hi @Darshanrawal971 Great question! To understand how Serverless works under the hood, it helps to break it down into two main concepts: Warm Pools and Secure Networking.1. How Databricks manages the Compute (Warm Pools)Instead of spinning up new Vir...

  • 0 kudos
1 More Replies
Raman_Unifeye
by Honored Contributor III
  • 3174 Views
  • 7 replies
  • 0 kudos

How to restrict Databricks Apps and Vector Search endpoint creation for workspace users

I am looking to restrict all workspace users' access to create Databricks Apps and Vector Search endpoints.I am aware there is no simple toggle, what is the best way to implement it?

  • 3174 Views
  • 7 replies
  • 0 kudos
Latest Reply
VitorAvancini
New Contributor III
  • 0 kudos

Is this something databricks is planning to add? seems like a simple and very important feature for governance

  • 0 kudos
6 More Replies
ShivannaGundana
by New Contributor II
  • 319 Views
  • 2 replies
  • 1 kudos

Databricks AWS Worker Nodes Not Registering with AWS Systems Manager (SSM)

Hi Team,We are investigating an issue where Databricks worker instances running on AWS are not registering with AWS Systems Manager (SSM).EnvironmentDatabricks Runtime: 17.3 LTSWorker OS: Ubuntu 24.04AWS EC2 worker instances launched by DatabricksIAM...

  • 319 Views
  • 2 replies
  • 1 kudos
Latest Reply
alexjames3123
New Contributor II
  • 1 kudos

@ShivannaGundana wrote:This is a helpful troubleshooting discussion for teams working with Databricks and AWS environments. Checking IAM permissions, network connectivity, and instance configuration are important steps when diagnosing SSM registratio...

  • 1 kudos
1 More Replies
LokeshChikuru
by Databricks Partner
  • 2297 Views
  • 3 replies
  • 1 kudos

VNet Data Gateway unable to connect to Azure Databricks Serverless SQL via Private Endpoint

I’m facing connectivity issues when trying to connect Microsoft Fabric / Power BI to Azure Databricks Serverless and PRO SQL Warehouse using a VNet Data Gateway. I’m looking for guidance on whether this scenario is supported or if there are known lim...

  • 2297 Views
  • 3 replies
  • 1 kudos
Latest Reply
LokeshChikuru
Databricks Partner
  • 1 kudos

This resolved after Azure Storage Service endpoint attached to the Vnet-Data Gateway subnet, then the Fabrics refresh was able to process the data.

  • 1 kudos
2 More Replies
Prasad329
by New Contributor II
  • 6375 Views
  • 3 replies
  • 2 kudos

Automating Version Control for Databricks Workflows

I am currently using Databricks Asset Bundles to manage and deploy workflows. While I have successfully automated the version control for notebooks, I am facing challenges with workflows. Specifically, I am looking to automate the process of fetching...

  • 6375 Views
  • 3 replies
  • 2 kudos
Latest Reply
renbud
New Contributor II
  • 2 kudos

I am facing the same issue as Prasad329.The recommended best practice is "*Always make changes in the GitHub-managed YAML (bundle)*". In my opinion this only makes sense if a good editor is provided for the source artifacts.For python there are good ...

  • 2 kudos
2 More Replies
connieyang
by Databricks Employee
  • 195 Views
  • 0 replies
  • 1 kudos

Participate in a Databricks user study!

Hi Databricks Community, I'm Connie from the Databricks UX research team!We are conducting a user study to understand how admins identify, investigate, and resolve governance issues in their Databricks environments. We'd love to connect with individ...

  • 195 Views
  • 0 replies
  • 1 kudos
APJESK
by Contributor
  • 743 Views
  • 4 replies
  • 2 kudos

Enterprise-level Unity Catalog governance

Hi everyoneI'm currently designing an enterprise-level Unity Catalog governance model for Databricks and would like to learn from others who have implemented it in production.I'm trying to understand what personas are actually required at each level,...

  • 743 Views
  • 4 replies
  • 2 kudos
Latest Reply
emma_s
Databricks Employee
  • 2 kudos

@APJESK, the existing replies from @balajij8 and @binlogreader cover the practical patterns well, in answer to your questions. But generally your design looks good with a few tweaks.   1. Single Terraform SP as Metastore Admin for provisioning - yes,...

  • 2 kudos
3 More Replies
alpines
by New Contributor II
  • 385 Views
  • 1 replies
  • 1 kudos

Resolved! Deactive Admin user

Hi Community,I have a Databricks account and workspaces that were previously setup by a user who is no longer with our company and I am attempting to remove admin access and deactive the user account. However as an Account admin user myself, when I a...

  • 385 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @alpines ,This error typically occurs when attempting to remove the 'account owner.' The account owner is the user who originally set up the Databricks account. This entitlement is attached to a user so that there is always at least one account ad...

  • 1 kudos
abhishek2k11
by New Contributor III
  • 2432 Views
  • 13 replies
  • 2 kudos

No workspace in Free Edition

Hi, I have been using free edition from some time using my this mail id. But from last 3-4 days I can’t see any workspace. when ever I am logging in I am getting two accounts name and In no workspace is available. When I tried creating another accoun...

  • 2432 Views
  • 13 replies
  • 2 kudos
Latest Reply
masonreed11
New Contributor II
  • 2 kudos

It sounds like you're signing into the wrong Atlassian account. Try logging in with the account that originally owned the workspace or a different sign-in method (Google, Microsoft, email). If the unused account is blocking you due to the free plan l...

  • 2 kudos
12 More Replies