cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

charl-p-botha
by Databricks Partner
  • 1949 Views
  • 6 replies
  • 4 kudos

How to limit the AI/BI dashboard sharing people-picker to workspace members

Dear community,We follow the environment-isolation guidance in [1], relying on between-workspace and within-workspace separation (Unity Catalog, catalog-workspace bindings, ACLs). In our case we have different groups of users each assigned to their o...

  • 1949 Views
  • 6 replies
  • 4 kudos
Latest Reply
Syntera
New Contributor II
  • 4 kudos

I have been raising the exact same concerns when we noticed these and other changes in how Databricks handles access and sharing. The lack of control options when new features are rolled out is not very customer oriented, especially since they are us...

  • 4 kudos
5 More Replies
RamenBhar
by New Contributor III
  • 795 Views
  • 5 replies
  • 5 kudos

Resolved! Can I connect Fabric Data Agent With Databricks Genie One as external connection

HiI have a fabric semantic model. I have created a fabric data agent (published) on top of the semantic model. Now i have created a unity catalog connection along with service. Is MCP connection is true. I can use this connection in AI playground or ...

RamenBhar_0-1785158729196.png
  • 795 Views
  • 5 replies
  • 5 kudos
Latest Reply
RamenBhar
New Contributor III
  • 5 kudos

Hi @Lu_Wang_ENB_DBX  - Apologies I forgot to mentioned that I have managed to solve this.Issue:I was creating service (MCP Service) under schema. This also creating MCP connection where "is_mcp_connection=true". This connection was not visible in the...

  • 5 kudos
4 More Replies
Darshanrawal971
by New Contributor
  • 452 Views
  • 2 replies
  • 0 kudos

How is Serverless Compute implemented under the hood?

Hi everyone,I've been reading about Serverless Compute and have a question about the underlying architecture.In the classic compute model, clusters are provisioned in the customer's cloud account. With Serverless, Databricks manages the compute, but ...

  • 452 Views
  • 2 replies
  • 0 kudos
Latest Reply
ShamenParis
Contributor III
  • 0 kudos

Hi @Darshanrawal971 Great question! To understand how Serverless works under the hood, it helps to break it down into two main concepts: Warm Pools and Secure Networking.1. How Databricks manages the Compute (Warm Pools)Instead of spinning up new Vir...

  • 0 kudos
1 More Replies
Raman_Unifeye
by Honored Contributor III
  • 3402 Views
  • 7 replies
  • 2 kudos

How to restrict Databricks Apps and Vector Search endpoint creation for workspace users

I am looking to restrict all workspace users' access to create Databricks Apps and Vector Search endpoints.I am aware there is no simple toggle, what is the best way to implement it?

  • 3402 Views
  • 7 replies
  • 2 kudos
Latest Reply
VitorAvancini
New Contributor III
  • 2 kudos

Is this something databricks is planning to add? seems like a simple and very important feature for governance

  • 2 kudos
6 More Replies
ShivannaGundana
by New Contributor II
  • 421 Views
  • 2 replies
  • 1 kudos

Databricks AWS Worker Nodes Not Registering with AWS Systems Manager (SSM)

Hi Team,We are investigating an issue where Databricks worker instances running on AWS are not registering with AWS Systems Manager (SSM).EnvironmentDatabricks Runtime: 17.3 LTSWorker OS: Ubuntu 24.04AWS EC2 worker instances launched by DatabricksIAM...

  • 421 Views
  • 2 replies
  • 1 kudos
Latest Reply
alexjames3123
New Contributor II
  • 1 kudos

@ShivannaGundana wrote:This is a helpful troubleshooting discussion for teams working with Databricks and AWS environments. Checking IAM permissions, network connectivity, and instance configuration are important steps when diagnosing SSM registratio...

  • 1 kudos
1 More Replies
LokeshChikuru
by Databricks Partner
  • 2481 Views
  • 3 replies
  • 1 kudos

VNet Data Gateway unable to connect to Azure Databricks Serverless SQL via Private Endpoint

I’m facing connectivity issues when trying to connect Microsoft Fabric / Power BI to Azure Databricks Serverless and PRO SQL Warehouse using a VNet Data Gateway. I’m looking for guidance on whether this scenario is supported or if there are known lim...

  • 2481 Views
  • 3 replies
  • 1 kudos
Latest Reply
LokeshChikuru
Databricks Partner
  • 1 kudos

This resolved after Azure Storage Service endpoint attached to the Vnet-Data Gateway subnet, then the Fabrics refresh was able to process the data.

  • 1 kudos
2 More Replies
Prasad329
by New Contributor II
  • 6461 Views
  • 3 replies
  • 2 kudos

Automating Version Control for Databricks Workflows

I am currently using Databricks Asset Bundles to manage and deploy workflows. While I have successfully automated the version control for notebooks, I am facing challenges with workflows. Specifically, I am looking to automate the process of fetching...

  • 6461 Views
  • 3 replies
  • 2 kudos
Latest Reply
renbud
New Contributor II
  • 2 kudos

I am facing the same issue as Prasad329.The recommended best practice is "*Always make changes in the GitHub-managed YAML (bundle)*". In my opinion this only makes sense if a good editor is provided for the source artifacts.For python there are good ...

  • 2 kudos
2 More Replies
connieyang
by Databricks Employee
  • 261 Views
  • 0 replies
  • 1 kudos

Participate in a Databricks user study!

Hi Databricks Community, I'm Connie from the Databricks UX research team!We are conducting a user study to understand how admins identify, investigate, and resolve governance issues in their Databricks environments. We'd love to connect with individ...

  • 261 Views
  • 0 replies
  • 1 kudos
APJESK
by Contributor
  • 1190 Views
  • 4 replies
  • 2 kudos

Enterprise-level Unity Catalog governance

Hi everyoneI'm currently designing an enterprise-level Unity Catalog governance model for Databricks and would like to learn from others who have implemented it in production.I'm trying to understand what personas are actually required at each level,...

  • 1190 Views
  • 4 replies
  • 2 kudos
Latest Reply
emma_s
Databricks Employee
  • 2 kudos

@APJESK, the existing replies from @balajij8 and @binlogreader cover the practical patterns well, in answer to your questions. But generally your design looks good with a few tweaks.   1. Single Terraform SP as Metastore Admin for provisioning - yes,...

  • 2 kudos
3 More Replies
alpines
by New Contributor II
  • 522 Views
  • 1 replies
  • 1 kudos

Resolved! Deactive Admin user

Hi Community,I have a Databricks account and workspaces that were previously setup by a user who is no longer with our company and I am attempting to remove admin access and deactive the user account. However as an Account admin user myself, when I a...

  • 522 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @alpines ,This error typically occurs when attempting to remove the 'account owner.' The account owner is the user who originally set up the Databricks account. This entitlement is attached to a user so that there is always at least one account ad...

  • 1 kudos
abhishek2k11
by New Contributor III
  • 3007 Views
  • 13 replies
  • 2 kudos

No workspace in Free Edition

Hi, I have been using free edition from some time using my this mail id. But from last 3-4 days I can’t see any workspace. when ever I am logging in I am getting two accounts name and In no workspace is available. When I tried creating another accoun...

  • 3007 Views
  • 13 replies
  • 2 kudos
Latest Reply
masonreed11
New Contributor III
  • 2 kudos

It sounds like you're signing into the wrong Atlassian account. Try logging in with the account that originally owned the workspace or a different sign-in method (Google, Microsoft, email). If the unused account is blocking you due to the free plan l...

  • 2 kudos
12 More Replies
LeandroVeiga10
by New Contributor II
  • 503 Views
  • 2 replies
  • 0 kudos

Databricks Free Edition – No Workspace Available

Hello Databricks Community,I recently created a Databricks Free Edition account. Although my account is active and I can sign in successfully, no workspace is available. The account console displays the following message: â€œYou are not a member of any...

  • 503 Views
  • 2 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 0 kudos

Hi LeandroVeiga10, This issue is affecting the Free Edition in certain areas. Create a new Free Edition account and select the Singapore region instead of the US or your default region during sign-up. You should be able to complete your studies and w...

  • 0 kudos
1 More Replies
zzepo
by New Contributor II
  • 945 Views
  • 3 replies
  • 1 kudos

Resolved! NCC private endpoint cannot be added

hi,Trying to set up serverless compute and can't create a private endpoint because "Private access endpoint service {endpoint name} is not supported because {endpoint name} is not supported for account {account name}". Following this thread but stuck...

  • 945 Views
  • 3 replies
  • 1 kudos
Latest Reply
binlogreader
New Contributor III
  • 1 kudos

On AWS, all private connectivity from serverless compute runs through a network connectivity configuration. The NCC is an account-level object that holds private endpoint rules, and attaching it to a workspace is what routes serverless traffic throug...

  • 1 kudos
2 More Replies
dk_negrana
by New Contributor
  • 414 Views
  • 2 replies
  • 0 kudos

Databricks Cost for additional Workspace in Azure

I am planning to create an additional workpace in Databricks. I just want to know if there is any additional cost in terms of billing. thanks in advance for the reponse.

  • 414 Views
  • 2 replies
  • 0 kudos
Latest Reply
ajaygshah
New Contributor III
  • 0 kudos

There is no charge to create workspaces. Please go ahead and create one. While you create one, pay close attention to the networking tab. By default, it creates a virtual network and the associated costs for it, you will have to bear. You can simply ...

  • 0 kudos
1 More Replies
eshwari
by New Contributor III
  • 1025 Views
  • 2 replies
  • 0 kudos

Group manage permission using terraform

I am creating groups in databricks using terraform. The service principal used to create these groups automatically get Manage permission on respective groups, but I want to assign this manage permission on all groups to one specific admin group. I c...

  • 1025 Views
  • 2 replies
  • 0 kudos
Latest Reply
binlogreader
New Contributor III
  • 0 kudos

Group manager is not a permission in `databricks_permissions`, it is an account-level role, and the resource that assigns those roles is `databricks_access_control_rule_set`.If you want your admin group to manage every group in the account, including...

  • 0 kudos
1 More Replies