- 553 Views
- 2 replies
- 1 kudos
Databricks AWS Worker Nodes Not Registering with AWS Systems Manager (SSM)
Hi Team,We are investigating an issue where Databricks worker instances running on AWS are not registering with AWS Systems Manager (SSM).EnvironmentDatabricks Runtime: 17.3 LTSWorker OS: Ubuntu 24.04AWS EC2 worker instances launched by DatabricksIAM...
- 553 Views
- 2 replies
- 1 kudos
- 1 kudos
@ShivannaGundana wrote:This is a helpful troubleshooting discussion for teams working with Databricks and AWS environments. Checking IAM permissions, network connectivity, and instance configuration are important steps when diagnosing SSM registratio...
- 1 kudos
- 2798 Views
- 3 replies
- 1 kudos
VNet Data Gateway unable to connect to Azure Databricks Serverless SQL via Private Endpoint
I’m facing connectivity issues when trying to connect Microsoft Fabric / Power BI to Azure Databricks Serverless and PRO SQL Warehouse using a VNet Data Gateway. I’m looking for guidance on whether this scenario is supported or if there are known lim...
- 2798 Views
- 3 replies
- 1 kudos
- 1 kudos
This resolved after Azure Storage Service endpoint attached to the Vnet-Data Gateway subnet, then the Fabrics refresh was able to process the data.
- 1 kudos
- 6640 Views
- 3 replies
- 2 kudos
Automating Version Control for Databricks Workflows
I am currently using Databricks Asset Bundles to manage and deploy workflows. While I have successfully automated the version control for notebooks, I am facing challenges with workflows. Specifically, I am looking to automate the process of fetching...
- 6640 Views
- 3 replies
- 2 kudos
- 2 kudos
I am facing the same issue as Prasad329.The recommended best practice is "*Always make changes in the GitHub-managed YAML (bundle)*". In my opinion this only makes sense if a good editor is provided for the source artifacts.For python there are good ...
- 2 kudos
- 312 Views
- 0 replies
- 1 kudos
Participate in a Databricks user study!
Hi Databricks Community, I'm Connie from the Databricks UX research team!We are conducting a user study to understand how admins identify, investigate, and resolve governance issues in their Databricks environments. We'd love to connect with individ...
- 312 Views
- 0 replies
- 1 kudos
- 1426 Views
- 4 replies
- 2 kudos
Enterprise-level Unity Catalog governance
Hi everyoneI'm currently designing an enterprise-level Unity Catalog governance model for Databricks and would like to learn from others who have implemented it in production.I'm trying to understand what personas are actually required at each level,...
- 1426 Views
- 4 replies
- 2 kudos
- 2 kudos
@APJESK, the existing replies from @balajij8 and @binlogreader cover the practical patterns well, in answer to your questions. But generally your design looks good with a few tweaks. 1. Single Terraform SP as Metastore Admin for provisioning - yes,...
- 2 kudos
- 956 Views
- 1 replies
- 1 kudos
Resolved! Deactive Admin user
Hi Community,I have a Databricks account and workspaces that were previously setup by a user who is no longer with our company and I am attempting to remove admin access and deactive the user account. However as an Account admin user myself, when I a...
- 956 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @alpines ,This error typically occurs when attempting to remove the 'account owner.' The account owner is the user who originally set up the Databricks account. This entitlement is attached to a user so that there is always at least one account ad...
- 1 kudos
- 3630 Views
- 13 replies
- 2 kudos
No workspace in Free Edition
Hi, I have been using free edition from some time using my this mail id. But from last 3-4 days I can’t see any workspace. when ever I am logging in I am getting two accounts name and In no workspace is available. When I tried creating another accoun...
- 3630 Views
- 13 replies
- 2 kudos
- 2 kudos
It sounds like you're signing into the wrong Atlassian account. Try logging in with the account that originally owned the workspace or a different sign-in method (Google, Microsoft, email). If the unused account is blocking you due to the free plan l...
- 2 kudos
- 1091 Views
- 2 replies
- 0 kudos
Databricks Free Edition – No Workspace Available
Hello Databricks Community,I recently created a Databricks Free Edition account. Although my account is active and I can sign in successfully, no workspace is available. The account console displays the following message: “You are not a member of any...
- 1091 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi LeandroVeiga10, This issue is affecting the Free Edition in certain areas. Create a new Free Edition account and select the Singapore region instead of the US or your default region during sign-up. You should be able to complete your studies and w...
- 0 kudos
- 1341 Views
- 3 replies
- 1 kudos
Resolved! NCC private endpoint cannot be added
hi,Trying to set up serverless compute and can't create a private endpoint because "Private access endpoint service {endpoint name} is not supported because {endpoint name} is not supported for account {account name}". Following this thread but stuck...
- 1341 Views
- 3 replies
- 1 kudos
- 1 kudos
On AWS, all private connectivity from serverless compute runs through a network connectivity configuration. The NCC is an account-level object that holds private endpoint rules, and attaching it to a workspace is what routes serverless traffic throug...
- 1 kudos
- 528 Views
- 2 replies
- 0 kudos
Databricks Cost for additional Workspace in Azure
I am planning to create an additional workpace in Databricks. I just want to know if there is any additional cost in terms of billing. thanks in advance for the reponse.
- 528 Views
- 2 replies
- 0 kudos
- 0 kudos
There is no charge to create workspaces. Please go ahead and create one. While you create one, pay close attention to the networking tab. By default, it creates a virtual network and the associated costs for it, you will have to bear. You can simply ...
- 0 kudos
- 1119 Views
- 2 replies
- 0 kudos
Group manage permission using terraform
I am creating groups in databricks using terraform. The service principal used to create these groups automatically get Manage permission on respective groups, but I want to assign this manage permission on all groups to one specific admin group. I c...
- 1119 Views
- 2 replies
- 0 kudos
- 0 kudos
Group manager is not a permission in `databricks_permissions`, it is an account-level role, and the resource that assigns those roles is `databricks_access_control_rule_set`.If you want your admin group to manage every group in the account, including...
- 0 kudos
- 1059 Views
- 3 replies
- 0 kudos
Setup Before Trainning
I have a training tomorrow, and I am missing notebooks that they send to be able to follow the training. Does anyone have them to share them? I already reached out to Databricks twice and see no hope.
- 1059 Views
- 3 replies
- 0 kudos
- 0 kudos
The notebooks are usually available within the Academy portal, and you can download them there. The instructors dedicate the first 15 minutes to environment setup and troubleshooting. If you encounter issues, notify the instructor in the meeting chat...
- 0 kudos
- 587 Views
- 2 replies
- 1 kudos
Workload Identity Federation on ADO for account level provider
I am using Workload Identity Federation for ADO pipelines to authenticate to databricks.I followed https://docs.databricks.com/aws/en/dev-tools/auth/provider-azure-devopsIt works with workspace url but doesn't work with account level url.I get error:...
- 587 Views
- 2 replies
- 1 kudos
- 1 kudos
You are using:Azure-style host: https://accounts.azuredatabricks.netAzure env vars: ARM_CLIENT_ID, ARM_TENANT_IDPlus DATABRICKS_CLIENT_IDThat often makes the SDK try a different OIDC flow than intended (hitting /oidc/accounts/<id>/v1/token) and faili...
- 1 kudos
- 772 Views
- 1 replies
- 1 kudos
Databricks App with Proprietary packages and code
Hello Databricks community,I have built an application that has a lot of proprietary code and packages that I chose not to show for the public- I just want my service to be accessible for the people who install the application through a Streamlit fro...
- 772 Views
- 1 replies
- 1 kudos
- 1 kudos
Hey Antoine, great questions — this is a common challenge when building commercial apps on Databricks. Let me address each area directly.The fundamental tradeoffThe core tension here is architectural: when code runs in the user's workspace, it's very...
- 1 kudos
- 634 Views
- 1 replies
- 1 kudos
No Egress for Serverless Workspace
Hello,I have a problemimport socket print(socket.gethostbyname("google.com"))[Trace ID: 00-9e5667936e24418dae4c39a9ed003a22-a43a5f2ca9b14451-00] --------------------------------------------------------------------------- gaierror ...
- 634 Views
- 1 replies
- 1 kudos
- 1 kudos
Greetings @Janis404 , Nice work pulling system.access.outbound_network and narrowing this to serverless. That table is where the answer lives, so let me walk through what it's telling you. Read the log rows first: access_type is DROP, which is real ...
- 1 kudos
