cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

nishaath
by New Contributor
  • 3783 Views
  • 1 replies
  • 0 kudos

Workspace creation is getting failed constanly

We are trying to create a workspace with custome VPC. But the creation is getting failed constantly.The error doesn't have any description which makes the troubleshoting hard.Does anyboday had similar issue like this before and has a solution? Thanks...

nishaath_1-1740998508239.png
  • 3783 Views
  • 1 replies
  • 0 kudos
Latest Reply
kamal_ch
Databricks Employee
  • 0 kudos

Hi Nisha, If you are still having the issue, I recommend opening a Support ticket with the workspace ID and any error details so that we can investigate. Regards Kamal

  • 0 kudos
jAAmes_bentley
by Contributor
  • 1566 Views
  • 1 replies
  • 1 kudos

Resolved! Databricks Apps - X-Forwarded-Access-Token not available

Hi all,I've recently been getting started with Databricks Apps, and have been trying to use on-behalf-of access. However, it seems that the X-Forwarded-Access-Token is not coming through in my app headers. I have lots of other X-Forwarded ones such a...

jAAmes_bentley_0-1753219027973.png jAAmes_bentley_1-1753219116820.png
  • 1566 Views
  • 1 replies
  • 1 kudos
Latest Reply
jAAmes_bentley
Contributor
  • 1 kudos

For anybody who comes across this post with the same issue, this issue is caused by enabling the on-behalf-of preview after deploying an App. The solution is to fully stop the App and then start it again after the preview has been enabled. Redeployin...

  • 1 kudos
hmnilp
by New Contributor II
  • 1231 Views
  • 2 replies
  • 0 kudos

Error with file events in external location (via pub/sub)

Hi everyone!I am new here and in Databricks world.I was trying to enable a trigger event on file uploading in GCP bucket in order to start a job following this tutorial: https://docs.databricks.com/gcp/en/connect/unity-catalog/cloud-storage/manage-ex...

hmnilp_0-1752831905771.png hmnilp_1-1752832082230.png hmnilp_3-1752832431023.png
  • 1231 Views
  • 2 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Contributor III
  • 0 kudos

Hey @hmnilp did you contact databricks, may be there is a feature to be enabled. 

  • 0 kudos
1 More Replies
ZD
by New Contributor III
  • 6997 Views
  • 8 replies
  • 1 kudos

Resolved! Creating Azure Databricks Workspace Without NAT Gateway

Hello,Recently, when I create a new Databricks workspace on Azure, it automatically create a NAT Gateway which incurs additional cost !When creating the workspace, I don't choose secure cluster connectivity, so I'm expecting not to have a NAT Gateway...

nat 1.jpg nat 2.jpg
  • 6997 Views
  • 8 replies
  • 1 kudos
Latest Reply
ZD
New Contributor III
  • 1 kudos

Make sure to disable the following option when creating your workspace, as it has recently become enabled by default.Deploy Azure Databricks workspace with Secure Cluster Connectivity (No Public IP) 

  • 1 kudos
7 More Replies
Ninad-Mulik
by New Contributor III
  • 1289 Views
  • 2 replies
  • 1 kudos

Resolved! How do I access Hive Metastore via API?

Hi,Is there any Databricks REST API to directly access Hive Metastore tables (like list of tables, schemas, columns) without using Unity Catalog or SQL Warehouse?I’m specifically looking to fetch metadata from hive_metastore.Thanks.

  • 1289 Views
  • 2 replies
  • 1 kudos
Latest Reply
SP_6721
Honored Contributor
  • 1 kudos

Hi @Ninad-Mulik ,As far as I know, there’s no Databricks REST API to directly access Hive Metastore metadata without using Unity Catalog or SQL Warehouses. The legacy Hive Metastore only supports SQL-based queries. REST APIs for metadata access are o...

  • 1 kudos
1 More Replies
Chinu
by New Contributor III
  • 1225 Views
  • 1 replies
  • 1 kudos

Resolved! Guidance on Managing Databricks Apps Whitelisting

Hi,Our workspace users currently have permissions to create Databricks apps, and we’ve observed a rise in associated costs. To address this, we’re developing an administrative notebook to:Check whether an app is whitelisted/approved from the admins.A...

  • 1225 Views
  • 1 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

Here are some helpful tips that you might find useful:   Summary of Best Practices and Recommendations for App Whitelisting and Automated App Removal in Databricks 1. Overview and Whitelisting Strategy To control costs and maintain governance over Da...

  • 1 kudos
Kim3
by New Contributor II
  • 2790 Views
  • 1 replies
  • 2 kudos

Delete Azure Databricks Workspace resource but reference remains in Account Console

As the title says. I have deleted both the Azure Databricks Workspace resource and the resource group it was located in. However, I can still see the workspace in the account console. Also, it appears in the response from GET https://accounts.azureda...

  • 2790 Views
  • 1 replies
  • 2 kudos
Latest Reply
Jcpenuela
New Contributor II
  • 2 kudos

Hi Kim3, same problem here, did you find a solution for this?Thanks!

  • 2 kudos
AndyK
by New Contributor II
  • 2226 Views
  • 6 replies
  • 1 kudos

Databricks Apps with FastAPI

I have a FastAPI Databricks App deployed to a hosted workspace. How can I call the API from external tools like Postman?P.S. I was able to call the API within the same browser.

  • 2226 Views
  • 6 replies
  • 1 kudos
Latest Reply
AndyK
New Contributor II
  • 1 kudos

Hi,Make sure your token endpoint url is like this: https://<databricks-instance>/oidc/v1/token.Refer here for workspace-level access token: https://docs.databricks.com/aws/en/dev-tools/auth/oauth-m2mAlso make sure you have granted access of the servi...

  • 1 kudos
5 More Replies
arun_prakash
by New Contributor
  • 981 Views
  • 2 replies
  • 0 kudos

Databricks Apps not working in postman

I have a question regarding Databricks Apps. I have deployed my databricks Apps, and its working on my laptop, but when I try to open the same url in my mobile its redirecting to databricks signin page, and also its not working through postman as wel...

  • 981 Views
  • 2 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

Is this issue specifically with the Databricks Apps am I right? Are you getting and erro message?

  • 0 kudos
1 More Replies
MarcusC
by New Contributor III
  • 1348 Views
  • 3 replies
  • 2 kudos

Databricks Apps

I've created a Databricks App that is essentially a REST Api in Flask. It returns a json object. Data is in sql-warehouse. It works when calling directly in browser but I want to access it with rest api and Bearer token. But when I login with a servi...

  • 1348 Views
  • 3 replies
  • 2 kudos
Latest Reply
Gareema
Contributor
  • 2 kudos

Did it work, I am trying something similar? If yes, please provide how you achieved it? 

  • 2 kudos
2 More Replies
tasozgurcem
by New Contributor
  • 1435 Views
  • 1 replies
  • 0 kudos

Is it possible to run all Python (not just Spark) via Databricks cluster from local IDE?

Hi all,When connecting to a Databricks cluster from a local IDE like VS Code, Spark operations already run on the cluster.But is there a way to route all Python code — not just Spark — to run directly on the Databricks cluster as well?Thanks!

  • 1435 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Databricks Employee
  • 0 kudos

Hello @tasozgurcem! If you want your whole Python script to run on the cluster, you can either upload the file or run it as a job using the Databricks extension.Check this out: https://docs.databricks.com/aws/en/dev-tools/vscode-ext/runhttps://docs.d...

  • 0 kudos
Yashbogam
by New Contributor II
  • 1418 Views
  • 5 replies
  • 0 kudos

Workspace Failed to Launch – Internal Error

 I'm encountering an issue while trying to launch a Databricks workspace on GCP.Has anyone experienced this before or know what might be causing it?Would appreciate any help!Error Message: "An internal error occurred when launching the workspace."  

Screenshot 2025-07-10 at 10.51.00 PM.png
  • 1418 Views
  • 5 replies
  • 0 kudos
Latest Reply
Yashbogam
New Contributor II
  • 0 kudos

I have all the quotas, and the Databricks support team told me to post in the community

  • 0 kudos
4 More Replies
KingAJ
by New Contributor II
  • 1145 Views
  • 2 replies
  • 0 kudos

How to Change Created By Field in SQL Warehouses Without Recreating Them?

I’m trying to update the "Created by" field on an existing SQL warehouse without having to recreate the entire warehouse. I attempted to use the Databricks Python SDK to run an update command, but unfortunately, it didn’t change the field.Has anyone ...

KingAJ_0-1752654507554.png
  • 1145 Views
  • 2 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @KingAJ ,Maybe you can try to use following REST API endpoint? There's a creator_name attribute that you can use.Update a warehouse | SQL Warehouses API | REST API reference | Databricks on AWS

  • 0 kudos
1 More Replies
dbx-soundar
by New Contributor II
  • 1142 Views
  • 2 replies
  • 1 kudos

Databricks Audit Logs Analysis

Please share the attributes related to the audit logsHow is the audit logs can be utilized by cyber security team? What are the insights into the audit logs and how we can maintain the compliance? What are the non-compliance items can be identified f...

  • 1142 Views
  • 2 replies
  • 1 kudos
Latest Reply
Walter_C
Databricks Employee
  • 1 kudos

The audit logs will only get the information of the events and actions being performed by users, service principals in the workspace, so there is no compliance actions being tracked itself.The Service name is a subgroup of items you want to check, so...

  • 1 kudos
1 More Replies
dipin_wantoo
by New Contributor
  • 1742 Views
  • 1 replies
  • 0 kudos

not able to configure databricks with aws

I am trying to set up Databricks with my AWS account but I am facing some issues, I followed the steps to create a new Databricks workspace using the AWS CloudFormation template or Databricks setup guide, But the CloudFormation stack fails every time...

  • 1742 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Databricks Employee
  • 0 kudos

Hello @dipin_wantoo! Can you please check the CloudFormation Stack Events for the exact error? That should help identify why the stack is failing. If you're looking to get started with Databricks as an individual user, the Express Setup is a simple w...

  • 0 kudos