cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

158576
by New Contributor
  • 439 Views
  • 2 replies
  • 0 kudos

mount cifs volume on all purpose compute results in permission denied

I have all networking already set, nslookup resolves NAS server IP and connectivity is enabled from worker nodes to nas server. I am able to mount the same nas drive outside of databricks, I mean standalone linux vm in the same VPC where worker nodes...

  • 439 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @158576, Sorry for the delay in getting back to you, and just closing the loop in case you’re still expecting an answer. Thanks for sharing the details. Based on what you’ve already validated, this does not sound like a basic networking problem. I...

  • 0 kudos
1 More Replies
yustus
by New Contributor III
  • 393 Views
  • 2 replies
  • 2 kudos

Resolved! API - Service Principle Secret Generation

Hi everyone,I am looking for a way to automatically create service principals, including their secrets, for M2M OAuth.I know that service principals can be created via the API, but it seems that creating secrets for those service principals via the A...

  • 393 Views
  • 2 replies
  • 2 kudos
Latest Reply
ShamenParis
New Contributor III
  • 2 kudos

Hi @yustus It’s great that you are prioritizing secure M2M OAuth over OBO tokens!while @szymon_dybczak already mentioned the Python SDK and Terraform, I wanted to offer a few alternative approaches depending on how your automation is set up:1. The Di...

  • 2 kudos
1 More Replies
dkxxx-rc
by Contributor
  • 471 Views
  • 2 replies
  • 1 kudos

Resolved! Work-around for cloning a repo with notebooks too big

Hi,It would be nice to be able to clone https://github.com/shap/shap into Databricks, it being such a standard.  But it fails because some of the notebooks violate a Databricks size limit.  Using sparse clone mode I can force my way through getting m...

  • 471 Views
  • 2 replies
  • 1 kudos
Latest Reply
dkxxx-rc
Contributor
  • 1 kudos

This looks sufficient, thanks.  I was able to run a clone in the CLI.  The folder ends up in an invalid git state, but that appears to be because the beta feature isn't turned on for my workspace yet.

  • 1 kudos
1 More Replies
lkahn
by New Contributor
  • 592 Views
  • 2 replies
  • 0 kudos

Resolved! UI issue with R plots

Starting on May 6, our workspace in ap-southeast-2 stopped being able to display R plots correctly. This is specific to this workspace (we have 3), and specific to R plots, and is occurring for all users and clusters.The figure itself can be resized ...

  • 592 Views
  • 2 replies
  • 0 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 0 kudos

This looks like a workspace-side notebook UI regression.  Recommendation Open a Databricks support ticket and treat it as a Notebook UI / rendering regression for that workspace. Include: Workspace IDRegion: ap-southeast-2Start date: May 6A notebook...

  • 0 kudos
1 More Replies
uhuru_furuta
by Databricks Partner
  • 4065 Views
  • 6 replies
  • 1 kudos

Can't start Serverless Warehouse after extend budget

As my budget was exhausted, my serverless warehouse stopped and I extended my budget, which is now 'Under Budget'.However, my serverless warehouse still can't start as pasted. It is about 19 hours after when I extend budget.Do I need to do any other ...

  • 4065 Views
  • 6 replies
  • 1 kudos
Latest Reply
MoJaMa
Databricks Employee
  • 1 kudos

To add to what Ganesh said, it seems that you have a Databricks Team (Account Executive and Solutions Architect). I would escalate this to them while you create the Support ticket in parallel. Based on what I can see, I think you had a Trial Account ...

  • 1 kudos
5 More Replies
simmestd
by New Contributor
  • 379 Views
  • 2 replies
  • 1 kudos

Built a chrome extension that shows live $/hr inside the databricks UI

Got annoyed by not being able to see real-time costs in Databricks whilst manipulating data pipelines. Built a Chrome extension sitting in the corner of the page, pulls cluster and warehouse state from the API every few seconds, multiplies by DBU rat...

  • 379 Views
  • 2 replies
  • 1 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 1 kudos

Yes, I’d install it — live cost is compelling — but it becomes daily-use only once it nudges behavior, not just informs.Live cost aloneValuable during notebook work, tuning, and experimentationHelps build immediate cost intuitionFeels “nice to have” ...

  • 1 kudos
1 More Replies
AMStrever
by New Contributor II
  • 565 Views
  • 3 replies
  • 0 kudos

Resolved! Databricks Platform Administration Fundamentals

I have enrolled in Databricks Platform Administration Fundamentals and on the Demo: "Using Databricks Utilities and CLI" it require"  you  to " open this Notebook in your workspace: 1- Using Databricks Utilities and CLi" Where does one obtain this No...

  • 565 Views
  • 3 replies
  • 0 kudos
Latest Reply
AMStrever
New Contributor II
  • 0 kudos

Ashwin for the response win. Thanks... however, unfortunately I do have a trial, as well as access multiple corporate workspaces. There are not "recreate steps" - in the training: it simply says " now open this notebook" which you need. It first give...

  • 0 kudos
2 More Replies
And2
by New Contributor
  • 232 Views
  • 0 replies
  • 0 kudos

Network Check Control Plane Failure- Vnet injection

Hi,I'm receiving the following error when trying to run a classic compute:Error message: [details] X_NHC_MULTIPLE_COMPONENTS_SSL_ERROR: Instance failed network health check before bootstrapping with fatal error: X_NHC_MULTIPLE_COMPONENTS_SSL_ERROR 3 ...

  • 232 Views
  • 0 replies
  • 0 kudos
vijayakunuri1
by New Contributor III
  • 1095 Views
  • 3 replies
  • 2 kudos

Resolved! I built a free 11-tab Cost Observability Dashboard as a Databricks App — open source

I built Databricks Cost Observability — a full-stack observability dashboardthat runs natively as a Databricks App and reads directly from system tables.No data leaves your workspace, no external BI tools needed.What it covers across 11 tabs:• Execut...

  • 1095 Views
  • 3 replies
  • 2 kudos
Latest Reply
vijayakunuri1
New Contributor III
  • 2 kudos

The main tradeoff: Azure Cost Management API has a 1-2 day lag, so the data is never truly real-time, but that's fine for a cost observability use case. We can have a ingestion notebook would run daily to get those cost ingested. Azure Cost Managemen...

  • 2 kudos
2 More Replies
LokeshChikuru
by Databricks Partner
  • 974 Views
  • 5 replies
  • 1 kudos

Databricks integrating with ServiceNow via Lakeflow Connect for data ingestion

Databricks integrating with ServiceNow via Lakeflow Connect for data ingestion and looking for guidance on enforcing integration-user based data access.Observed behaviourU2M OAuth authentication succeeds when ServiceNow access is granted to the works...

  • 974 Views
  • 5 replies
  • 1 kudos
Latest Reply
LokeshChikuru
Databricks Partner
  • 1 kudos

Hi @emma_s I’ve reviewed the setup and wanted to clarify the behavior I’m seeing with the ServiceNow connector and U2M OAuth.The ServiceNow connection was created successfully using a U2M OAuth integration user, and that integration user has admin pe...

  • 1 kudos
4 More Replies
sparkplug
by Contributor
  • 6089 Views
  • 15 replies
  • 19 kudos

Resolved! I need a switch to turn off Data Apps in databricks workspaces

HiHow do I disable Data Apps on my workspace. This is really annoying that Databricks pushes new features without any option to disable them. At least you should have some tools to control access before rolling it out. It seems you only care about fe...

  • 6089 Views
  • 15 replies
  • 19 kudos
Latest Reply
dbdev
Databricks Partner
  • 19 kudos

I'm an account level admin and can't find any options manage creation access of Databricks Apps in the account console. Where can I limit app creation in the Account Console?

  • 19 kudos
14 More Replies
dermoritz
by Databricks Partner
  • 938 Views
  • 5 replies
  • 3 kudos

Spark config ignored in job run settings

i am talking about this setting: i tried so far:spark.executor.cores 8andspark.log.level INFOBoth documented here: https://spark.apache.org/docs/latest/configuration.htmlbut neither i see effect nor i see them set if i check sparkui -> environment ta...

Screenshot 2026-03-25 150815.png Screenshot 2026-03-25 151527.png
  • 938 Views
  • 5 replies
  • 3 kudos
Latest Reply
emma_s
Databricks Employee
  • 3 kudos

Hi, You're not putting in the wrong place, it's just that Databricks doesn't allow certain configs, because they are managed by Databricks for you. For example your core spark config you've shown above won't be recognised as this is set by selected c...

  • 3 kudos
4 More Replies
abhijit007
by Databricks Partner
  • 1744 Views
  • 2 replies
  • 1 kudos

Resolved! Running Browser Based Agentic Applications on Databricks

Hi,We are evaluating whether it is possible to host a browser‑based agentic application on Databricks.Our application performs frontend UI automation using the browser-use Python library and also exposes FastAPI endpoints to drive a UI..Application O...

  • 1744 Views
  • 2 replies
  • 1 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 1 kudos

TLDR: Databricks Apps/serverless won’t support this pattern; classic compute with Databricks Container Services is your only real option on Databricks, and even that has trade‑offs. For serious browser automation, run it off‑platform and integrate wi...

  • 1 kudos
1 More Replies
NikeshPurohit
by Databricks Partner
  • 3348 Views
  • 1 replies
  • 1 kudos

Unable to connect Claude connector to Databricks MCP server (Genie)

Hello everyone,I am trying to connect Claude’s Custom Connector (Remote MCP) to a Databricks Managed MCP Server using a Genie space, but I keep encountering an authentication connection error. I would appreciate guidance on whether this is a configur...

  • 3348 Views
  • 1 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hi, updating from my previous post to give the latest update. As of two weeks ago, there is a public preview for this, it needs to be enabled in your workspace. You also need to have the Claude IP added to Databricks if you have any IP workspace rest...

  • 1 kudos
RikL
by Databricks Partner
  • 817 Views
  • 2 replies
  • 2 kudos

Resolved! Automatic Identity Management with Nested Groups and API Access

Hi all,I’m exploring Automatic Identity Management for synchronizing nested groups in Azure Databricks. According to the documentation, this feature supports nested groups: Automatic Identity ManagementHowever, the same article notes that groups sync...

  • 817 Views
  • 2 replies
  • 2 kudos
Latest Reply
emma_s
Databricks Employee
  • 2 kudos

Hi, I've just had a look internally and there is some discussion about making this functionality available but I can't give you a definitive idea of when this might be.  In terms of workarounds the best one I can find is to use Tarracurl to make raw ...

  • 2 kudos
1 More Replies