- 2514 Views
- 5 replies
- 5 kudos
Resolved! How-to migrate catalog storage account to another storage account
Hi,we have a Azure Databricks Workspace that uses Unity Catalog for storing data. We use a seperate storage account to store the catalogs. We need to enable the option "Infrastructure encryption" on this storage account and this is unfortunatly onl...
- 2514 Views
- 5 replies
- 5 kudos
- 5 kudos
@Marco37 yes overall sound good.Just remember some points:Delta Lake transaction log history won't be copied (basically querying to a version of won't work)CDC history will be lostLineage can be lost after 'catalog swap'RLS/column masking stuff can't...
- 5 kudos
- 905 Views
- 2 replies
- 1 kudos
Built a chrome extension that shows live $/hr inside the databricks UI
Got annoyed by not being able to see real-time costs in Databricks whilst manipulating data pipelines. Built a Chrome extension sitting in the corner of the page, pulls cluster and warehouse state from the API every few seconds, multiplies by DBU rat...
- 905 Views
- 2 replies
- 1 kudos
- 1 kudos
Yes, I’d install it — live cost is compelling — but it becomes daily-use only once it nudges behavior, not just informs.Live cost aloneValuable during notebook work, tuning, and experimentationHelps build immediate cost intuitionFeels “nice to have” ...
- 1 kudos
- 650 Views
- 1 replies
- 0 kudos
Databricks permissions management at scale
Working with permissions in Databricks at scale gets tricky pretty fast.A few patterns that keep coming up:permissions spread across workspaces, catalogs, groupshard to answer simple questions like “who actually has access to X?”lots of manual queryi...
- 650 Views
- 1 replies
- 0 kudos
- 0 kudos
Cool solution!A lot of the auditing of what you have built will actually be available as part of the Governance Hub. It is built on the system tables- It also contains a lot of other cool features that are more in the areas of Data Quality, Classific...
- 0 kudos
- 3228 Views
- 4 replies
- 1 kudos
Resolved! DBSQL MCP Server - how to specify compute cluster?
Hi,the DBSQL MCP Server is really cool, however, I am not sure how to connect it to a specific cluster, and I could not find any information in any documentation page. My MCP settings looks like this:"databricks-sql-mcp": { "type": "streamable-http",...
- 3228 Views
- 4 replies
- 1 kudos
- 1 kudos
Thanks @Ashwin_DSA for your solution suggested here! we have a related situation. We have an AI-gateway that brokers connections to that externally-hosted Datbricks instance. As a result, we need a SQL warehouse to execute queries and can't alllocate...
- 1 kudos
- 1097 Views
- 3 replies
- 0 kudos
Resolved! Databricks Platform Administration Fundamentals
I have enrolled in Databricks Platform Administration Fundamentals and on the Demo: "Using Databricks Utilities and CLI" it require" you to " open this Notebook in your workspace: 1- Using Databricks Utilities and CLi" Where does one obtain this No...
- 1097 Views
- 3 replies
- 0 kudos
- 0 kudos
Ashwin for the response win. Thanks... however, unfortunately I do have a trial, as well as access multiple corporate workspaces. There are not "recreate steps" - in the training: it simply says " now open this notebook" which you need. It first give...
- 0 kudos
- 2414 Views
- 4 replies
- 1 kudos
Serverless Access to Public internet
HiI am trying to run notebooks on serverless compute but I cannot access the public internet. I cannot perform a get on google.com getting "[Errno -3] Temporary failure in name resolution". I checked my admin console network policies and they all wer...
- 2414 Views
- 4 replies
- 1 kudos
- 1 kudos
Greetings @jpm2617 , I did some digging and would like to share my thoughts: @szymon_dybczak nailed the root cause. Your [Errno -3] Temporary failure in name resolution when calling google.com is the classic symptom of a workspace attached to a restr...
- 1 kudos
- 1333 Views
- 1 replies
- 0 kudos
Resolved! API does not return Genie space create and last modified dates
I am using "/api/2.0/genie/spaces" endpoint to retrieve genie spaces, but this does not return "created date" and "last modified dates". Is there a way to retrieve above information?
- 1333 Views
- 1 replies
- 0 kudos
- 0 kudos
Hi @Beka, Unfortunately, no. Those timestamps aren’t exposed for Genie spaces today. The GenieSpace resource behind both GET /api/2.0/genie/spaces and GET /api/2.0/genie/spaces/{space_id} contains only fields such as space_id, title, description, par...
- 0 kudos
- 2439 Views
- 3 replies
- 2 kudos
Resolved! I built a free 11-tab Cost Observability Dashboard as a Databricks App — open source
I built Databricks Cost Observability — a full-stack observability dashboardthat runs natively as a Databricks App and reads directly from system tables.No data leaves your workspace, no external BI tools needed.What it covers across 11 tabs:• Execut...
- 2439 Views
- 3 replies
- 2 kudos
- 2 kudos
The main tradeoff: Azure Cost Management API has a 1-2 day lag, so the data is never truly real-time, but that's fine for a cost observability use case. We can have a ingestion notebook would run daily to get those cost ingested. Azure Cost Managemen...
- 2 kudos
- 506 Views
- 0 replies
- 0 kudos
Feature Request: API support for Context-Based Ingress Control IP lists
I know that context-based ingress control is currently a preview feature, but it is an extremely important one. It removes the need for workspace-level IP access lists, making it much easier to govern allowed IPs centrally and preventing workspace-le...
- 506 Views
- 0 replies
- 0 kudos
- 1914 Views
- 5 replies
- 1 kudos
Databricks integrating with ServiceNow via Lakeflow Connect for data ingestion
Databricks integrating with ServiceNow via Lakeflow Connect for data ingestion and looking for guidance on enforcing integration-user based data access.Observed behaviourU2M OAuth authentication succeeds when ServiceNow access is granted to the works...
- 1914 Views
- 5 replies
- 1 kudos
- 1 kudos
Hi @emma_s I’ve reviewed the setup and wanted to clarify the behavior I’m seeing with the ServiceNow connector and U2M OAuth.The ServiceNow connection was created successfully using a U2M OAuth integration user, and that integration user has admin pe...
- 1 kudos
- 1545 Views
- 4 replies
- 0 kudos
Resolved! Cannot enable GPU for serving endpoint
Good morning, I want to create a serving endpoint with a GPU. However, I get a warning "GPU is not enabled for this workspace". Your AI chatbot is telling me I have to contact someone at Databricks. I tried this form - https://www.databricks.com/comp...
- 1545 Views
- 4 replies
- 0 kudos
- 2344 Views
- 1 replies
- 1 kudos
Integration patterns with Oracle database
Hello everyoneI'd like to try integration of Data Bricks with on-premise Oracle database, and now I have the following fundamental questions as below about the architectures of that integration.1) I guess the following is the list of integration way...
- 2344 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi @HideK253, Your list is essentially correct. The main Databricks-native patterns are export to files + COPY INTO / Auto Loader, Lakehouse Federation and Lakeflow Connect. A couple of other options are listed below. Custom Spark JDBC jobs: spark.re...
- 1 kudos
- 3117 Views
- 6 replies
- 1 kudos
Resolved! How to make an Entra group available for GRANT commands inside a workspace?
We're using Azure Databricks and automatic identity management. Users and groups sync over automatically.If I want to grant permissions to an Entra group to a schema, I can't just run something like this in a workspace notebook:GRANT USE SCHEMA ON SC...
- 3117 Views
- 6 replies
- 1 kudos
- 1 kudos
Hi @mzs, To make sure we suggest the right option, can you share a bit more about your setup? Cloud & workspace type: Are you on Azure Databricks, and is the workspace identity-federated (Unity Catalog enabled)?Identity sync: Are you using Automatic ...
- 1 kudos
- 5029 Views
- 1 replies
- 1 kudos
Resolved! Databricks CLI token creation fails with “cannot configure default credentials”
Hello, I have been generating a Databricks personal access token in my YAML-based CI pipeline using a bash script. The pipeline installs the Databricks CLI and then creates a token using a Service Principal (Azure AD application) credentials.Current ...
- 5029 Views
- 1 replies
- 1 kudos
- 1 kudos
Hi, I'm pretty sure what you're hitting is stricter auth detection in the newer CLI/SDK. Your error shows azure_tenant_id, client_id, and client_secret all populated, so it's seeing more than one credential type and refusing to guess between them. Th...
- 1 kudos
- 26470 Views
- 26 replies
- 19 kudos
how do you disable serverless interactive compute for all users
I don't want users using serverless interactive compute for their jobs. how do i disable it for everyone or for specific users
- 26470 Views
- 26 replies
- 19 kudos
- 19 kudos
Btw. I just realized that at least with VNet injected workspaces you probably can prevent any sensible serverless usage by not giving permissions and network route to the needed resources. At least in Azure Databricks, notebooks need access to Databr...
- 19 kudos
