- 757 Views
- 2 replies
- 0 kudos
AI Runtime Public Preview?
How can I get access to AI runtime? I see that it is in 'Public Preview' but I dont see a feature toggle for it on the account Previews page.https://docs.databricks.com/aws/en/machine-learning/ai-runtime/
- 757 Views
- 2 replies
- 0 kudos
- 0 kudos
The confusion comes from AI Runtime having two components with different preview states.Single-node tasks are already open and do not require any toggle. You can just open a notebook, click the Connect dropdown, select Serverless GPU, choose your acc...
- 0 kudos
- 577 Views
- 2 replies
- 1 kudos
Resolved! Which role is recommended to create and manage Unity Catalog objects—Workspace Admin or Metastore Ad
Which role is recommended to create and manage Unity Catalog objects (catalog, schema, Storage credentials, External Location)—Workspace Admin or Metastore Admin—and why?
- 577 Views
- 2 replies
- 1 kudos
- 1 kudos
I am designing the security model for our Databricks platform and need guidance on role selection for managing Unity Catalog. Which role should be used for creating and managing Unity Catalog objects such as Storage Credentials, External Locations, C...
- 1 kudos
- 682 Views
- 5 replies
- 3 kudos
Spark config ignored in job run settings
i am talking about this setting: i tried so far:spark.executor.cores 8andspark.log.level INFOBoth documented here: https://spark.apache.org/docs/latest/configuration.htmlbut neither i see effect nor i see them set if i check sparkui -> environment ta...
- 682 Views
- 5 replies
- 3 kudos
- 3 kudos
Hi, You're not putting in the wrong place, it's just that Databricks doesn't allow certain configs, because they are managed by Databricks for you. For example your core spark config you've shown above won't be recognised as this is set by selected c...
- 3 kudos
- 1381 Views
- 2 replies
- 1 kudos
Resolved! Running Browser Based Agentic Applications on Databricks
Hi,We are evaluating whether it is possible to host a browser‑based agentic application on Databricks.Our application performs frontend UI automation using the browser-use Python library and also exposes FastAPI endpoints to drive a UI..Application O...
- 1381 Views
- 2 replies
- 1 kudos
- 1 kudos
TLDR: Databricks Apps/serverless won’t support this pattern; classic compute with Databricks Container Services is your only real option on Databricks, and even that has trade‑offs. For serious browser automation, run it off‑platform and integrate wi...
- 1 kudos
- 692 Views
- 1 replies
- 0 kudos
Power BI Service refresh failures caused by intermittent Databricks credential invalidation
Hi everyone,We are experiencing an intermittent issue in Power BI Service where datasets and dataflows connected directly to Databricks start failing refreshes because the credentials appear to be lost or invalidated, even though no manual changes we...
- 692 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi, This is a known issue with how the Power BI Service handles OAuth refresh tokens with Databricks. Databricks enables Single-Use Refresh Tokens (SURTs) by default for Power BI integrations. If a token refresh fails mid-flight (network hiccup, timi...
- 0 kudos
- 2392 Views
- 1 replies
- 1 kudos
Unable to connect Claude connector to Databricks MCP server (Genie)
Hello everyone,I am trying to connect Claude’s Custom Connector (Remote MCP) to a Databricks Managed MCP Server using a Genie space, but I keep encountering an authentication connection error. I would appreciate guidance on whether this is a configur...
- 2392 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi, updating from my previous post to give the latest update. As of two weeks ago, there is a public preview for this, it needs to be enabled in your workspace. You also need to have the Claude IP added to Databricks if you have any IP workspace rest...
- 1 kudos
- 651 Views
- 2 replies
- 2 kudos
Resolved! Automatic Identity Management with Nested Groups and API Access
Hi all,I’m exploring Automatic Identity Management for synchronizing nested groups in Azure Databricks. According to the documentation, this feature supports nested groups: Automatic Identity ManagementHowever, the same article notes that groups sync...
- 651 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi, I've just had a look internally and there is some discussion about making this functionality available but I can't give you a definitive idea of when this might be. In terms of workarounds the best one I can find is to use Tarracurl to make raw ...
- 2 kudos
- 602 Views
- 4 replies
- 0 kudos
Private Route53 hosted zone for cloud.databricks.com
We have Tailscale deployed on the same VPC as our Databricks workspaces. To enable PrivateLink for some workspaces, we created a private Route53 hosted zone for cloud.databricks.com with CNAME records pointing workspace hostnames to the PrivateLink e...
- 602 Views
- 4 replies
- 0 kudos
- 0 kudos
Thank you for your response. I added a new private hosted zone in Amazon Route 53 for privatelink.cloud.databricks.com, and created an A record for us-east-1.privatelink.cloud.databricks.com pointing to the private endpoint IP.I had a question regard...
- 0 kudos
- 1335 Views
- 3 replies
- 1 kudos
Resolved! [AZURE] Usage of self managable Storage Account instead Default Databricks File Storage
Hi Team,I’m encountering an issue with my architecture.I’m using VNet Injection and serverless with NCC. Our organization has a firewall controlling both inbound and outbound traffic.I want to restrict all traffic to private networks only, but I ran...
- 1335 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi TENDK, That is expected behavior and does not necessarily mean something is wrong. Here is what is happening: When you run nslookup from inside a Databricks notebook, the notebook is executing on a cluster that sits inside the Databricks-managed V...
- 1 kudos
- 2719 Views
- 4 replies
- 3 kudos
Resolved! Markdown Cells Do Not Render Consistently
When I am creating a notebook in the UI editor on DataBricks, markdown cells do not always render after I run them. They still appear in 'editing mode'. See the screenshot below, it should have rendered a H1.Again, this behavior is not consistent. So...
- 2719 Views
- 4 replies
- 3 kudos
- 3 kudos
Hi @bdanielatl I had the same issue. Google AI's one suggestion of refreshing the browser helped me resolved the issue. Another suggestion (among other suggestions of Google AI) was to clear the cache of the browser.
- 3 kudos
- 816 Views
- 2 replies
- 2 kudos
Resolved! Terraform folder structure and states
Hi everyone, I have a few questions regarding Terraform folder structure and state management for Databricks, and I'd love to get your opinions.For context, our Databricks environment is already deployed and Unity Catalog is configured. The Terraform...
- 816 Views
- 2 replies
- 2 kudos
- 2 kudos
Hi @ismaelhenzel, In terms of your first question, Terraform automatically loads all *.tf files in the same directory, so it’s common practice to organise them by concern. For example, envs/ prod/ backend.tf # remote state config ...
- 2 kudos
- 450 Views
- 1 replies
- 0 kudos
Resolved! Accidentally Removed myself as account admin
Dear Support Team, I am currently on a 14-day free trial of the Premium Edition and have accidentally removed myself as the account administrator. As I was the only admin, I am now locked out and unable to log in to the account. Could you please help...
- 450 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @wonoh90 Thanks for reaching out and sorry you’re running into this. Since this involves restoring admin access at the account level, it’s not something the community can fix directly. You’ll need to open a support ticket with Databricks so the su...
- 0 kudos
- 978 Views
- 2 replies
- 3 kudos
Resolved! Best practice:Using Databricks managed storage vs customer‑owned ADLS for enterprise production data
We are currently setting up Azure Databricks for enterprise analytics and wanted to validate our storage architecture against Databricks best practices.Today, we are ingesting data directly from external enterprise sources (Oracle DB, SQL Server, etc...
- 978 Views
- 2 replies
- 3 kudos
- 3628 Views
- 1 replies
- 0 kudos
Lakehouse Federation - Unable to connect to Snowflake using "PEM Private Key"
Hi,I'm currently using Lakehouse Federation feature on databricks to run queries against Snowflake datawarehouse. Today I'm using a service credential to establish the connection (user id & pwd), but I have to change it to use private key. I tried us...
- 3628 Views
- 1 replies
- 0 kudos
- 0 kudos
Can you check if you have encrypted your keys . The Snowflake JDBC driver does not support authentication with encrypted private keys. https://docs.databricks.com/aws/en/query-federation/snowflake-pem#limitationsTry generating the key with no encryp...
- 0 kudos
- 399 Views
- 1 replies
- 1 kudos
Resolved! Downgrade from Enterprise to Premium Plan
We upgraded to Enterprise to test something and we want now to switch back to Premium Plan. How can I achieve this. Am I forced to create a new account and delete this one?
- 399 Views
- 1 replies
- 1 kudos
- 1 kudos
No need to cancel your account. There is no self-service option to downgrade your account. Please submit a support ticket and work with your Databricks account team to downgrade.
- 1 kudos
