cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

simmestd
by New Contributor
  • 355 Views
  • 2 replies
  • 1 kudos

Built a chrome extension that shows live $/hr inside the databricks UI

Got annoyed by not being able to see real-time costs in Databricks whilst manipulating data pipelines. Built a Chrome extension sitting in the corner of the page, pulls cluster and warehouse state from the API every few seconds, multiplies by DBU rat...

  • 355 Views
  • 2 replies
  • 1 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 1 kudos

Yes, I’d install it — live cost is compelling — but it becomes daily-use only once it nudges behavior, not just informs.Live cost aloneValuable during notebook work, tuning, and experimentationHelps build immediate cost intuitionFeels “nice to have” ...

  • 1 kudos
1 More Replies
lukaszmaron
by New Contributor III
  • 273 Views
  • 1 replies
  • 0 kudos

Databricks permissions management at scale

Working with permissions in Databricks at scale gets tricky pretty fast.A few patterns that keep coming up:permissions spread across workspaces, catalogs, groupshard to answer simple questions like “who actually has access to X?”lots of manual queryi...

lukaszmaron_0-1778534349989.png
  • 273 Views
  • 1 replies
  • 0 kudos
Latest Reply
KrisJohannesen
Contributor III
  • 0 kudos

Cool solution!A lot of the auditing of what you have built will actually be available as part of the Governance Hub. It is built on the system tables- It also contains a lot of other cool features that are more in the areas of Data Quality, Classific...

  • 0 kudos
koti521
by New Contributor II
  • 388 Views
  • 3 replies
  • 0 kudos

How to prevent direct workspace changes in Databricks by vendors / external users?

Hi Team,I’m looking for guidance on workspace governance and change control in Databricks, specifically related to vendor access.We recently observed that workspace-level changes seem to be applied directly, and we want to understand how this is happ...

  • 388 Views
  • 3 replies
  • 0 kudos
Latest Reply
Brahmareddy
Esteemed Contributor II
  • 0 kudos

Thanks for adding more details.Since PAT and Databricks personnel workspace access are already disabled, I would suggest first reviewing audit logs to identify whether the change was made by a workspace admin, account admin, service principal, Terraf...

  • 0 kudos
2 More Replies
LokeshChikuru
by Databricks Partner
  • 886 Views
  • 2 replies
  • 0 kudos

VNet Data Gateway unable to connect to Azure Databricks Serverless SQL via Private Endpoint

I’m facing connectivity issues when trying to connect Microsoft Fabric / Power BI to Azure Databricks Serverless and PRO SQL Warehouse using a VNet Data Gateway. I’m looking for guidance on whether this scenario is supported or if there are known lim...

  • 886 Views
  • 2 replies
  • 0 kudos
Latest Reply
LokeshChikuru
Databricks Partner
  • 0 kudos

We are able to fix the connectivity issue by correcting the NSG rules between Azure Databricks private endpoint and Fabrics Vnet gateway subnet.But errors are being occured while powerBI service semantic model query refresh using same Databricks conn...

  • 0 kudos
1 More Replies
rdruska
by New Contributor II
  • 1555 Views
  • 4 replies
  • 1 kudos

Resolved! DBSQL MCP Server - how to specify compute cluster?

Hi,the DBSQL MCP Server is really cool, however, I am not sure how to connect it to a specific cluster, and I could not find any information in any documentation page. My MCP settings looks like this:"databricks-sql-mcp": { "type": "streamable-http",...

  • 1555 Views
  • 4 replies
  • 1 kudos
Latest Reply
WendyW
New Contributor II
  • 1 kudos

Thanks @Ashwin_DSA for your solution suggested here! we have a related situation. We have an AI-gateway that brokers connections to that externally-hosted Datbricks instance. As a result, we need a SQL warehouse to execute queries and can't alllocate...

  • 1 kudos
3 More Replies
AMStrever
by New Contributor II
  • 518 Views
  • 3 replies
  • 0 kudos

Resolved! Databricks Platform Administration Fundamentals

I have enrolled in Databricks Platform Administration Fundamentals and on the Demo: "Using Databricks Utilities and CLI" it require"  you  to " open this Notebook in your workspace: 1- Using Databricks Utilities and CLi" Where does one obtain this No...

  • 518 Views
  • 3 replies
  • 0 kudos
Latest Reply
AMStrever
New Contributor II
  • 0 kudos

Ashwin for the response win. Thanks... however, unfortunately I do have a trial, as well as access multiple corporate workspaces. There are not "recreate steps" - in the training: it simply says " now open this notebook" which you need. It first give...

  • 0 kudos
2 More Replies
jpm2617
by New Contributor II
  • 717 Views
  • 4 replies
  • 1 kudos

Serverless Access to Public internet

HiI am trying to run notebooks on serverless compute but I cannot access the public internet. I cannot perform a get on google.com getting "[Errno -3] Temporary failure in name resolution". I checked my admin console network policies and they all wer...

  • 717 Views
  • 4 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @jpm2617 , I did some digging and would like to share my thoughts: @szymon_dybczak nailed the root cause. Your [Errno -3] Temporary failure in name resolution when calling google.com is the classic symptom of a workspace attached to a restr...

  • 1 kudos
3 More Replies
garyng
by New Contributor
  • 180 Views
  • 0 replies
  • 0 kudos

Getting 500 error on UC external HTTP connection to Entra with OAuth User-to-Machine Per User

I am getting 500 Internal Server Error with Unity Catalog external HTTP connection to Entra (for accessing Microsoft Graph API):There isn't any special setup with my Entra app, just the default one with my workspace url as the redirect url:Microsoft ...

garyng_0-1777659141734.png garyng_1-1777659403816.png
  • 180 Views
  • 0 replies
  • 0 kudos
Beka
by New Contributor II
  • 691 Views
  • 1 replies
  • 0 kudos

Resolved! API does not return Genie space create and last modified dates

I am using "/api/2.0/genie/spaces" endpoint to retrieve genie spaces, but this does not return "created date" and "last modified dates". Is there a way to retrieve above information?

  • 691 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @Beka, Unfortunately, no. Those timestamps aren’t exposed for Genie spaces today. The GenieSpace resource behind both GET /api/2.0/genie/spaces and GET /api/2.0/genie/spaces/{space_id} contains only fields such as space_id, title, description, par...

  • 0 kudos
And2
by New Contributor
  • 224 Views
  • 0 replies
  • 0 kudos

Network Check Control Plane Failure- Vnet injection

Hi,I'm receiving the following error when trying to run a classic compute:Error message: [details] X_NHC_MULTIPLE_COMPONENTS_SSL_ERROR: Instance failed network health check before bootstrapping with fatal error: X_NHC_MULTIPLE_COMPONENTS_SSL_ERROR 3 ...

  • 224 Views
  • 0 replies
  • 0 kudos
vijayakunuri1
by New Contributor III
  • 1068 Views
  • 3 replies
  • 2 kudos

Resolved! I built a free 11-tab Cost Observability Dashboard as a Databricks App — open source

I built Databricks Cost Observability — a full-stack observability dashboardthat runs natively as a Databricks App and reads directly from system tables.No data leaves your workspace, no external BI tools needed.What it covers across 11 tabs:• Execut...

  • 1068 Views
  • 3 replies
  • 2 kudos
Latest Reply
vijayakunuri1
New Contributor III
  • 2 kudos

The main tradeoff: Azure Cost Management API has a 1-2 day lag, so the data is never truly real-time, but that's fine for a cost observability use case. We can have a ingestion notebook would run daily to get those cost ingested. Azure Cost Managemen...

  • 2 kudos
2 More Replies
ismaelhenzel
by Valued Contributor
  • 249 Views
  • 0 replies
  • 0 kudos

Feature Request: API support for Context-Based Ingress Control IP lists

I know that context-based ingress control is currently a preview feature, but it is an extremely important one. It removes the need for workspace-level IP access lists, making it much easier to govern allowed IPs centrally and preventing workspace-le...

  • 249 Views
  • 0 replies
  • 0 kudos
LokeshChikuru
by Databricks Partner
  • 925 Views
  • 5 replies
  • 1 kudos

Databricks integrating with ServiceNow via Lakeflow Connect for data ingestion

Databricks integrating with ServiceNow via Lakeflow Connect for data ingestion and looking for guidance on enforcing integration-user based data access.Observed behaviourU2M OAuth authentication succeeds when ServiceNow access is granted to the works...

  • 925 Views
  • 5 replies
  • 1 kudos
Latest Reply
LokeshChikuru
Databricks Partner
  • 1 kudos

Hi @emma_s I’ve reviewed the setup and wanted to clarify the behavior I’m seeing with the ServiceNow connector and U2M OAuth.The ServiceNow connection was created successfully using a U2M OAuth integration user, and that integration user has admin pe...

  • 1 kudos
4 More Replies
eduardo_guerra
by New Contributor III
  • 736 Views
  • 4 replies
  • 0 kudos

Resolved! Cannot enable GPU for serving endpoint

Good morning, I want to create a serving endpoint with a GPU. However, I get a warning "GPU is not enabled for this workspace". Your AI chatbot is telling me I have to contact someone at Databricks. I tried this form - https://www.databricks.com/comp...

  • 736 Views
  • 4 replies
  • 0 kudos
Latest Reply
eduardo_guerra
New Contributor III
  • 0 kudos

Thank you very much 

  • 0 kudos
3 More Replies
HideK253
by New Contributor
  • 802 Views
  • 1 replies
  • 0 kudos

Integration patterns with Oracle database

Hello everyoneI'd like to try integration of Data Bricks with on-premise Oracle database, and now I have the following  fundamental questions as below about the architectures of that integration.1) I guess the following is the list of integration way...

  • 802 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @HideK253, Your list is essentially correct. The main Databricks-native patterns are export to files + COPY INTO / Auto Loader, Lakehouse Federation and Lakeflow Connect. A couple of other options are listed below. Custom Spark JDBC jobs: spark.re...

  • 0 kudos