cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

jkraat
by New Contributor II
  • 995 Views
  • 3 replies
  • 0 kudos

Setup Before Trainning

I have a training tomorrow, and I am missing notebooks that they send to be able to follow the training. Does anyone have them to share them? I already reached out to Databricks twice and see no hope.

  • 995 Views
  • 3 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 0 kudos

The notebooks are usually available within the Academy portal, and you can download them there. The instructors dedicate the first 15 minutes to environment setup and troubleshooting. If you encounter issues, notify the instructor in the meeting chat...

  • 0 kudos
2 More Replies
eshwari
by New Contributor III
  • 495 Views
  • 2 replies
  • 1 kudos

Workload Identity Federation on ADO for account level provider

I am using Workload Identity Federation for ADO pipelines to authenticate to databricks.I followed https://docs.databricks.com/aws/en/dev-tools/auth/provider-azure-devopsIt works with workspace url but doesn't work with account level url.I get error:...

  • 495 Views
  • 2 replies
  • 1 kudos
Latest Reply
zubisid19
New Contributor II
  • 1 kudos

You are using:Azure-style host: https://accounts.azuredatabricks.netAzure env vars: ARM_CLIENT_ID, ARM_TENANT_IDPlus DATABRICKS_CLIENT_IDThat often makes the SDK try a different OIDC flow than intended (hitting /oidc/accounts/<id>/v1/token) and faili...

  • 1 kudos
1 More Replies
antoine_laurent
by New Contributor II
  • 575 Views
  • 1 replies
  • 1 kudos

Databricks App with Proprietary packages and code

Hello Databricks community,I have built an application that has a lot of proprietary code and packages that I chose not to show for the public- I just want my service to be accessible for the people who install the application through a Streamlit fro...

  • 575 Views
  • 1 replies
  • 1 kudos
Latest Reply
GabFernandes
Contributor
  • 1 kudos

Hey Antoine, great questions — this is a common challenge when building commercial apps on Databricks. Let me address each area directly.The fundamental tradeoffThe core tension here is architectural: when code runs in the user's workspace, it's very...

  • 1 kudos
Janis404
by New Contributor
  • 579 Views
  • 1 replies
  • 1 kudos

No Egress for Serverless Workspace

Hello,I have a problemimport socket print(socket.gethostbyname("google.com"))[Trace ID: 00-9e5667936e24418dae4c39a9ed003a22-a43a5f2ca9b14451-00] --------------------------------------------------------------------------- gaierror ...

  • 579 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Greetings @Janis404 ,  Nice work pulling system.access.outbound_network and narrowing this to serverless. That table is where the answer lives, so let me walk through what it's telling you. Read the log rows first: access_type is DROP, which is real ...

  • 1 kudos
tesshy-amane
by New Contributor
  • 403 Views
  • 1 replies
  • 0 kudos

X-Forwarded-Access-Token occasionally return stale values from a previous session

Hi all,I'm running a Streamlit app on Databricks Apps with On-Behalf-Of User Authorization enabled. We've observed that X-Forwarded-Access-Token and X-Forwarded-Email sometimes return values that belong to a previous session(logged out other user, us...

  • 403 Views
  • 1 replies
  • 0 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 0 kudos

This almost always turns out to be st.cache_resource on the connection, not the reverse proxy reusing anything. You said you checked your st.cache_data functions and they key on username, which is the right instinct, but the leak usually hides in wha...

  • 0 kudos
Fikrat
by Databricks Partner
  • 550 Views
  • 2 replies
  • 1 kudos

How to change passkey device for partner-academy.databricks.com?

Hi there,I've registered to partner-academy.databricks.com with my Slalom account, and it requires mobile phone passkey on each login. The problem is the passkey I've configured long ago is on my old phone and I can't find place in that web site that...

  • 550 Views
  • 2 replies
  • 1 kudos
Latest Reply
Fikrat
Databricks Partner
  • 1 kudos

Thanks, @Advika , I'll  follow thaT advice.

  • 1 kudos
1 More Replies
satycse06
by New Contributor III
  • 925 Views
  • 3 replies
  • 1 kudos

Resolved! enable databricks in azure for the whole tenant

Hi,We have to enable the databricks in azure cloud for the whole organisation in azure.I want to know the very 1st level i.e how to enable or integrate the databricks account with azure tenant and after that how I can enbale it for selected subscript...

  • 925 Views
  • 3 replies
  • 1 kudos
Latest Reply
satycse06
New Contributor III
  • 1 kudos

@szymon_dybczak Thanks for the response and well explanation.I have another question related to vnet injection architecture. So as per you we can create a management group and include all the subscription in that management group and will apply the p...

  • 1 kudos
2 More Replies
psingh13
by New Contributor II
  • 1097 Views
  • 3 replies
  • 1 kudos

Resolved! Oracle Connectivity - CDC

Hi Team,Has Databricks released CDC(Change data Capture) for Oracle Ingestion(public preview or GA)?I was able to see this option in free edition but want to make sure.Please check attached screenshot.Also, I understand that there are steps mentioned...

  • 1097 Views
  • 3 replies
  • 1 kudos
Latest Reply
harisrinivasay
Contributor
  • 1 kudos

Answer: Not yet.As of now, Oracle is not listed as a supported CDC (Change Data Capture) database connector in Lakeflow Connect managed CDC connectors.Databricks has recently introduced Query-Based Connectors for databases including Oracle. These con...

  • 1 kudos
2 More Replies
lukaszmaron
by New Contributor III
  • 2246 Views
  • 1 replies
  • 0 kudos

Genie Code Usage Dashboard

As of July 8th, 2026, Genie - including Genie Code, Genie Agents, and Genie One - moved to a pay-as-you-go model. Databricks gives account admins the tools for their side of the problem: budgets that track per-user spend, block usage beyond a per-use...

  • 2246 Views
  • 1 replies
  • 0 kudos
Latest Reply
rkhbo3003
New Contributor III
  • 0 kudos

I built the same however i paramterized queries based on workspace and even implemented RLS to that , we have even implemented alerts etc

  • 0 kudos
PNC
by Databricks Partner
  • 2042 Views
  • 3 replies
  • 3 kudos

Using Terraform to GRANT SELECT ON ANY FILE securable

I have a use case where service principals will read .csv files from Azure Storage Account and create views from them. This used to work in our legacy environment but we are currently migrating to Unity Catalog and when we tested our existing jobs we...

  • 2042 Views
  • 3 replies
  • 3 kudos
Latest Reply
ThePussCat
Databricks Partner
  • 3 kudos

How about... (not tried it myself)resource "databricks_sql_permissions" "grant_select_any_file" {any_file = true privilege_assignments { principal = "your-role" privileges = ["SELECT"] }}

  • 3 kudos
2 More Replies
APJESK
by Contributor
  • 630 Views
  • 2 replies
  • 0 kudos

Clarification on Auto Loader Managed File Events with Unity Catalog Managed Volumes

Hi Databricks Team,I'm trying to understand how Auto Loader Managed File Events work with Unity Catalog Managed Volumes, and I'm looking for some clarification.My understandingI create an External Location:  CREATE EXTERNAL LOCATION app_ext_locURL 's...

  • 630 Views
  • 2 replies
  • 0 kudos
Latest Reply
ShamenParis
Contributor III
  • 0 kudos

The confusion here usually stems from overlapping two different architectural concepts: the "Landing Zone" (where raw data arrives) and "Managed Storage" (where Databricks governs the data lifecycle).To address your questions directly:1. Does Databri...

  • 0 kudos
1 More Replies
Th0rs7en
by New Contributor II
  • 343 Views
  • 1 replies
  • 2 kudos

SPOG discovery probe failed

Databricks adapter: SPOG discovery probe to 'https://adb-1235610976271489.3.azuredatabricks.net/.well-known/databricks-config' failed after 3 attempts (last error: HTTPSConnectionPool(host='adb-1235610976271489.3.azuredatabricks.net', port=443): Max ...

  • 343 Views
  • 1 replies
  • 2 kudos
Latest Reply
Miss_Maee
New Contributor II
  • 2 kudos

In simple terms, this error means:Your computer tried to connect to your Databricks workspace, but it couldn't verify the website's security certificate.The important part is:  certificate verify failed: self-signed certificate in certificate chain  ...

  • 2 kudos
ovbioba
by New Contributor
  • 738 Views
  • 1 replies
  • 1 kudos

Resolved! Zerobus ingestion fails in Databricks

I have premium databricks and i am trying to use ZeroBus with java SDK. my SP has admin rights and the righst below have been granted to the zerobus table GRANT USE CATALOG ON CATALOG <catalog> TO `<service-principal-id>`; GRANT USE SCHEMA ON SCHEMA ...

  • 738 Views
  • 1 replies
  • 1 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 1 kudos

Use a Databricks OAuth token for Zerobus, not a PAT or a federated/token-exchange token. The Java SDK docs now use client_id + client_secret, and Zerobus requires a token scoped to api://databricks/workspaces/<workspace_id>/zerobusDirectWriteApi with...

  • 1 kudos
Jefke
by New Contributor III
  • 1007 Views
  • 3 replies
  • 3 kudos

Resolved! Did something change with the setup of Unity Catalogs?

Just some background. I deliver quite some trainings on Azure Databricks and in these trainings students have to provisions their own Azure Databricks workspace and UC. In the past this always went smoothly.Go to the Azure Portal Create a storage acc...

Jefke_0-1783497472715.png
  • 1007 Views
  • 3 replies
  • 3 kudos
Latest Reply
Jefke
New Contributor III
  • 3 kudos

Hi Ogbenisho,I have one follow up question on the 6 steps you describe:In step 4 and 5 you assume there is already a UC metastore to create the credentials and external location in.And then in step 6 you create it the UC metastoreBu what if you have ...

  • 3 kudos
2 More Replies
tsuppalapati
by New Contributor II
  • 786 Views
  • 3 replies
  • 0 kudos

Integration of mongodb and Databricks Serverless

Hi, I'm looking to integrate the databricks serverless workspace with Mongodb atlas through the private endpoint route. Created a NCC rule from databricks. From Mongodb side I cannot see the request to approve the connection, Thanks, Tarun

  • 786 Views
  • 3 replies
  • 0 kudos
Latest Reply
AbhilashNagilla
Databricks Employee
  • 0 kudos

Is this on AWS or Azure?  

  • 0 kudos
2 More Replies