cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

garyng
by New Contributor
  • 295 Views
  • 0 replies
  • 0 kudos

Getting 500 error on UC external HTTP connection to Entra with OAuth User-to-Machine Per User

I am getting 500 Internal Server Error with Unity Catalog external HTTP connection to Entra (for accessing Microsoft Graph API):There isn't any special setup with my Entra app, just the default one with my workspace url as the redirect url:Microsoft ...

garyng_0-1777659141734.png garyng_1-1777659403816.png
  • 295 Views
  • 0 replies
  • 0 kudos
Beka
by New Contributor II
  • 1044 Views
  • 1 replies
  • 0 kudos

Resolved! API does not return Genie space create and last modified dates

I am using "/api/2.0/genie/spaces" endpoint to retrieve genie spaces, but this does not return "created date" and "last modified dates". Is there a way to retrieve above information?

  • 1044 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @Beka, Unfortunately, no. Those timestamps aren’t exposed for Genie spaces today. The GenieSpace resource behind both GET /api/2.0/genie/spaces and GET /api/2.0/genie/spaces/{space_id} contains only fields such as space_id, title, description, par...

  • 0 kudos
And2
by New Contributor
  • 396 Views
  • 0 replies
  • 0 kudos

Network Check Control Plane Failure- Vnet injection

Hi,I'm receiving the following error when trying to run a classic compute:Error message: [details] X_NHC_MULTIPLE_COMPONENTS_SSL_ERROR: Instance failed network health check before bootstrapping with fatal error: X_NHC_MULTIPLE_COMPONENTS_SSL_ERROR 3 ...

  • 396 Views
  • 0 replies
  • 0 kudos
vijayakunuri1
by New Contributor III
  • 1863 Views
  • 3 replies
  • 2 kudos

Resolved! I built a free 11-tab Cost Observability Dashboard as a Databricks App — open source

I built Databricks Cost Observability — a full-stack observability dashboardthat runs natively as a Databricks App and reads directly from system tables.No data leaves your workspace, no external BI tools needed.What it covers across 11 tabs:• Execut...

  • 1863 Views
  • 3 replies
  • 2 kudos
Latest Reply
vijayakunuri1
New Contributor III
  • 2 kudos

The main tradeoff: Azure Cost Management API has a 1-2 day lag, so the data is never truly real-time, but that's fine for a cost observability use case. We can have a ingestion notebook would run daily to get those cost ingested. Azure Cost Managemen...

  • 2 kudos
2 More Replies
ismaelhenzel
by Valued Contributor
  • 428 Views
  • 0 replies
  • 0 kudos

Feature Request: API support for Context-Based Ingress Control IP lists

I know that context-based ingress control is currently a preview feature, but it is an extremely important one. It removes the need for workspace-level IP access lists, making it much easier to govern allowed IPs centrally and preventing workspace-le...

  • 428 Views
  • 0 replies
  • 0 kudos
LokeshChikuru
by Databricks Partner
  • 1622 Views
  • 5 replies
  • 1 kudos

Databricks integrating with ServiceNow via Lakeflow Connect for data ingestion

Databricks integrating with ServiceNow via Lakeflow Connect for data ingestion and looking for guidance on enforcing integration-user based data access.Observed behaviourU2M OAuth authentication succeeds when ServiceNow access is granted to the works...

  • 1622 Views
  • 5 replies
  • 1 kudos
Latest Reply
LokeshChikuru
Databricks Partner
  • 1 kudos

Hi @emma_s I’ve reviewed the setup and wanted to clarify the behavior I’m seeing with the ServiceNow connector and U2M OAuth.The ServiceNow connection was created successfully using a U2M OAuth integration user, and that integration user has admin pe...

  • 1 kudos
4 More Replies
eduardo_guerra
by New Contributor III
  • 1170 Views
  • 4 replies
  • 0 kudos

Resolved! Cannot enable GPU for serving endpoint

Good morning, I want to create a serving endpoint with a GPU. However, I get a warning "GPU is not enabled for this workspace". Your AI chatbot is telling me I have to contact someone at Databricks. I tried this form - https://www.databricks.com/comp...

  • 1170 Views
  • 4 replies
  • 0 kudos
Latest Reply
eduardo_guerra
New Contributor III
  • 0 kudos

Thank you very much 

  • 0 kudos
3 More Replies
HideK253
by New Contributor
  • 1999 Views
  • 1 replies
  • 1 kudos

Integration patterns with Oracle database

Hello everyoneI'd like to try integration of Data Bricks with on-premise Oracle database, and now I have the following  fundamental questions as below about the architectures of that integration.1) I guess the following is the list of integration way...

  • 1999 Views
  • 1 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @HideK253, Your list is essentially correct. The main Databricks-native patterns are export to files + COPY INTO / Auto Loader, Lakehouse Federation and Lakeflow Connect. A couple of other options are listed below. Custom Spark JDBC jobs: spark.re...

  • 1 kudos
mzs
by Contributor
  • 2285 Views
  • 6 replies
  • 1 kudos

Resolved! How to make an Entra group available for GRANT commands inside a workspace?

We're using Azure Databricks and automatic identity management. Users and groups sync over automatically.If I want to grant permissions to an Entra group to a schema, I can't just run something like this in a workspace notebook:GRANT USE SCHEMA ON SC...

  • 2285 Views
  • 6 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @mzs, To make sure we suggest the right option, can you share a bit more about your setup? Cloud & workspace type: Are you on Azure Databricks, and is the workspace identity-federated (Unity Catalog enabled)?Identity sync: Are you using Automatic ...

  • 1 kudos
5 More Replies
gannicus
by New Contributor II
  • 4207 Views
  • 1 replies
  • 1 kudos

Resolved! Databricks CLI token creation fails with “cannot configure default credentials”

Hello, I have been generating a Databricks personal access token in my YAML-based CI pipeline using a bash script. The pipeline installs the Databricks CLI and then creates a token using a Service Principal (Azure AD application) credentials.Current ...

  • 4207 Views
  • 1 replies
  • 1 kudos
Latest Reply
emma_s
Databricks Employee
  • 1 kudos

Hi, I'm pretty sure what you're hitting is stricter auth detection in the newer CLI/SDK. Your error shows azure_tenant_id, client_id, and client_secret all populated, so it's seeing more than one credential type and refusing to guess between them. Th...

  • 1 kudos
DataCurious
by New Contributor III
  • 25236 Views
  • 26 replies
  • 19 kudos

how do you disable serverless interactive compute for all users

I don't want users using serverless interactive compute for their jobs. how do i disable it for everyone or for specific users

  • 25236 Views
  • 26 replies
  • 19 kudos
Latest Reply
timo2024
Databricks Partner
  • 19 kudos

Btw. I just realized that at least with VNet injected workspaces you probably can prevent any sensible serverless usage by not giving permissions and network route to the needed resources. At least in Azure Databricks, notebooks need access to Databr...

  • 19 kudos
25 More Replies
sparkplug
by Contributor
  • 7892 Views
  • 15 replies
  • 19 kudos

Resolved! I need a switch to turn off Data Apps in databricks workspaces

HiHow do I disable Data Apps on my workspace. This is really annoying that Databricks pushes new features without any option to disable them. At least you should have some tools to control access before rolling it out. It seems you only care about fe...

  • 7892 Views
  • 15 replies
  • 19 kudos
Latest Reply
dbdev
Databricks Partner
  • 19 kudos

I'm an account level admin and can't find any options manage creation access of Databricks Apps in the account console. Where can I limit app creation in the Account Console?

  • 19 kudos
14 More Replies
lubiarzm1
by Contributor
  • 813 Views
  • 2 replies
  • 1 kudos

Resolved! Logs from dlt-execution computes

Hi guys!I faced an issue with the permission model in Databricks.Data engineers in my team are using a Pipeline that runs on serverless compute. The permissions for the pipeline are configured correctly, for example as follows:resource "databricks_pe...

lubiarzm1_0-1776332612242.png
  • 813 Views
  • 2 replies
  • 1 kudos
Latest Reply
lubiarzm1
Contributor
  • 1 kudos

Thanks a lot for help !

  • 1 kudos
1 More Replies
miraijaz
by New Contributor II
  • 1190 Views
  • 1 replies
  • 1 kudos

Resolved! Naming covention guidelines

Dear all,Appreciate if anyone  can provide the document/source related to Naming convention that can be followed within Databricks.  Regards,Aijaz

  • 1190 Views
  • 1 replies
  • 1 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 1 kudos

Hi @miraijaz , Databricks doesn’t enforce a single enterprise-wide naming standard, but there are a few official/public guidelines you can lean on. See the "Names" section of the SQL language reference.This covers allowed characters, length limits, a...

  • 1 kudos
KrumIT
by New Contributor
  • 1060 Views
  • 3 replies
  • 0 kudos

Resolved! Workspace deployed via AWS Marketplace.

Workspace deployed via AWS Marketplace.Internal endpoint 10.53.215.1 exists in VPC butSSL handshake fails. Cannot connect to metastore.Workspace URL: dbc-bb08dd2f-f142.cloud.databricks.comAWS Account: 452456948535Region: us-east-1"

  • 1060 Views
  • 3 replies
  • 0 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 0 kudos

Databricks endpoints present certificates for hostnames like *.cloud.databricks.com (or *.privatelink.cloud.databricks.com when PrivateLink is enabled). If your client connects to https://10.53.215.1 directly, the TLS ClientHello typically lacks the ...

  • 0 kudos
2 More Replies