Hello,Is there a sample code snippet that depicts end-to-end OIDC flow - imagine, there exists a service principal, interactive user who connect to an sql warehouse, get authenticated, and run some sql queries as part of a python script (jdbc/odbc) f...
how to subscribe the Databricks product from AWS - market place using Terraform or other automation tool
Hi @APJESK ,Nope, that first step needs to be done manually (and it makes sense because you need to handle billing terms etc.)But then you can use Terraform to automate nearly everything i.e Unity Catalog assets, creation of workspaces, clusters etc....
Dear all,I am currently testing Lakebase for integration in our overall system. In particular I need to enable RLS on a Lakebase table, which is synced from a "Delta Streaming Table" in UC. Setting up the data sync was no trouble, in UC I am the owne...
Hi, I have an organizational account who is the owner of the databricks workspace (premium) and also the global administrator. Still, I don't see "Account Console" option in the databricks after clicking the "manage account" option.I have tried to cl...
Hi @szymon_dybczak ,Yes have databricks premium account and admin as well
Hi I am trying to create a service principal federation policy against AKS cluster. But I am struggling to make it work without any examples. It would be great if you could share examples on how this would work for a service account.Additionally, wha...
Hello, I'm trying to establish the connection between dbx serverless account which is in "Account A" to the api gateway dns name which is in "Account B" is failing. i have created a api gateway with the custom domain for ex : "api-dev.amazon.com" and...
Hello @ilir_nuredini ,I'm trying the below way import requestsimport json API_URL = 'https://api-dev.amazon.com/v1/quality'headers = { "Authorization": f"Bearer {token}", "Content-Type": "application/json"}response = requests.get(API_URL, heade...
Hi everyone,I’m trying to create a Databricks workspace on AWS by following the official quick start guide:https://docs.databricks.com/aws/en/admin/workspace/quick-startHowever, my CloudFormation stack fails with the following error: The resource cr...
Hi @Lovebo , I'm not too familiar with AWS but happy to have a go at helping. Let's see if we can rule out some of the more obvious things which are easy to miss on the documentation.First of all, are you just following the guide through: https://doc...
Hi allIs it possible to configure the access_control_list block ((basically that contains permissions)) from a single place outside of Databricks job definition? This is changing as we are re-defining our permissions model, and each time resulting in...
Hello @noorbasha534 If you are trying to alter the permissions across many jobs at scale, I believe there are a couple of options to help speed up the process. Firstly, creating groups of users should help, as you can then easily change an entire gro...
I cannot make the databricks_credential resource create a service credential. It works fine with storage credentials. However, when i put `purpose = "SERVICE"` plus aws_iam_role and comment, in the apply phase it fails with `Error: cannot create cred...
I have the same error message now when trying to create a USE_SCHEMA grant for a service principal as in https://registry.terraform.io/providers/databricks/databricks/latest/docs/resources/grant#schema-grants . I create a new service principal and th...
Simple question : what is the way to go to install libraries on job clusters ? There does not seem to be a "Libraries" tab on the UI as opposed to regular clusters. Does it mean that the only option is to use init scripts ?
Frankly, I'm also scratching my head about this library installation conundrum in job clusters; the missing Libraries tab is definitely throwing me off. Seems like init scripts are the only officially sanctioned route, which feels a bit clunky. Are t...
Databricks allows a cluster to have a maximum of 150 execution context. If a number of execution context is attached and running operations on a databricks cluster with a driver and n workers, then how is the execution scheduled? I am assuming that o...
Ok i get it.An execution context is not bound to cpu. It is like a session. So basically the limit of 150 execution contexts mean that 150 sessions/spark programs can run simultaneously on the cluster (whether that is possible on the hardware is an...
I am trying to deploy an additional workspace to my AWS Account with terraform, I keep running into this authentication an error message below, I have searched everywhere in my account console and used chatgpt which keep point me to the account con...
Hello all,As of Thursday 20th 2025, we started to have our alert notifications being sent via Microsoft Teams with no formatting (raw HTML).We use a custom template with QUERY_RESULT_TABLE and a few html tags.Looks like databricks alerts deprecated ...
Hello,Thanks for sharing the explanation and link to the Microsoft's documentation.We had removed the HTML formatting a few months ago.
Is there a way to enforce tags on SQL Warehouses? Regular cluster policies do not apply to SQL Warehouses and budget policies do not cover SQL Warehouses either, which I find quite surprising given the fact that budget policies are documented as "Att...
@Michael_Appiah this isn't any area I'm familiar with but I thought I'd try and get the ball rolling. Have you looked into this https://docs.databricks.com/aws/en/admin/clusters/policy-definition . It could be a red herring from me, but your article ...
I'm running into an issue with my Databricks workspace in Azure in my own VNet. I've successfully created two private endpoints: databricks_ui_api and browser_authenticationHowever, when I try to create a cluster, I get the following error:CONTROL_PL...
Hello @eshwari Good day, I think szymon_dybczak and me provided enough information, please let me know if you had the solutions.If you found the solution useful, you can select the solution for the solution which helps others. Have a greate day!
