cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

AndyK
by New Contributor II
  • 1569 Views
  • 6 replies
  • 1 kudos

Databricks Apps with FastAPI

I have a FastAPI Databricks App deployed to a hosted workspace. How can I call the API from external tools like Postman?P.S. I was able to call the API within the same browser.

  • 1569 Views
  • 6 replies
  • 1 kudos
Latest Reply
AndyK
New Contributor II
  • 1 kudos

Hi,Make sure your token endpoint url is like this: https://<databricks-instance>/oidc/v1/token.Refer here for workspace-level access token: https://docs.databricks.com/aws/en/dev-tools/auth/oauth-m2mAlso make sure you have granted access of the servi...

  • 1 kudos
5 More Replies
arun_prakash
by New Contributor
  • 752 Views
  • 2 replies
  • 0 kudos

Databricks Apps not working in postman

I have a question regarding Databricks Apps. I have deployed my databricks Apps, and its working on my laptop, but when I try to open the same url in my mobile its redirecting to databricks signin page, and also its not working through postman as wel...

  • 752 Views
  • 2 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

Is this issue specifically with the Databricks Apps am I right? Are you getting and erro message?

  • 0 kudos
1 More Replies
MarcusC
by New Contributor III
  • 1129 Views
  • 3 replies
  • 2 kudos

Databricks Apps

I've created a Databricks App that is essentially a REST Api in Flask. It returns a json object. Data is in sql-warehouse. It works when calling directly in browser but I want to access it with rest api and Bearer token. But when I login with a servi...

  • 1129 Views
  • 3 replies
  • 2 kudos
Latest Reply
Gareema
Contributor
  • 2 kudos

Did it work, I am trying something similar? If yes, please provide how you achieved it? 

  • 2 kudos
2 More Replies
tasozgurcem
by New Contributor
  • 1315 Views
  • 1 replies
  • 0 kudos

Is it possible to run all Python (not just Spark) via Databricks cluster from local IDE?

Hi all,When connecting to a Databricks cluster from a local IDE like VS Code, Spark operations already run on the cluster.But is there a way to route all Python code — not just Spark — to run directly on the Databricks cluster as well?Thanks!

  • 1315 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Databricks Employee
  • 0 kudos

Hello @tasozgurcem! If you want your whole Python script to run on the cluster, you can either upload the file or run it as a job using the Databricks extension.Check this out: https://docs.databricks.com/aws/en/dev-tools/vscode-ext/runhttps://docs.d...

  • 0 kudos
Yashbogam
by New Contributor II
  • 1247 Views
  • 5 replies
  • 0 kudos

Workspace Failed to Launch – Internal Error

 I'm encountering an issue while trying to launch a Databricks workspace on GCP.Has anyone experienced this before or know what might be causing it?Would appreciate any help!Error Message: "An internal error occurred when launching the workspace."  

Screenshot 2025-07-10 at 10.51.00 PM.png
  • 1247 Views
  • 5 replies
  • 0 kudos
Latest Reply
Yashbogam
New Contributor II
  • 0 kudos

I have all the quotas, and the Databricks support team told me to post in the community

  • 0 kudos
4 More Replies
KingAJ
by New Contributor II
  • 1034 Views
  • 2 replies
  • 0 kudos

How to Change Created By Field in SQL Warehouses Without Recreating Them?

I’m trying to update the "Created by" field on an existing SQL warehouse without having to recreate the entire warehouse. I attempted to use the Databricks Python SDK to run an update command, but unfortunately, it didn’t change the field.Has anyone ...

KingAJ_0-1752654507554.png
  • 1034 Views
  • 2 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @KingAJ ,Maybe you can try to use following REST API endpoint? There's a creator_name attribute that you can use.Update a warehouse | SQL Warehouses API | REST API reference | Databricks on AWS

  • 0 kudos
1 More Replies
dbx-soundar
by New Contributor II
  • 882 Views
  • 2 replies
  • 1 kudos

Databricks Audit Logs Analysis

Please share the attributes related to the audit logsHow is the audit logs can be utilized by cyber security team? What are the insights into the audit logs and how we can maintain the compliance? What are the non-compliance items can be identified f...

  • 882 Views
  • 2 replies
  • 1 kudos
Latest Reply
Walter_C
Databricks Employee
  • 1 kudos

The audit logs will only get the information of the events and actions being performed by users, service principals in the workspace, so there is no compliance actions being tracked itself.The Service name is a subgroup of items you want to check, so...

  • 1 kudos
1 More Replies
dipin_wantoo
by New Contributor
  • 467 Views
  • 1 replies
  • 0 kudos

not able to configure databricks with aws

I am trying to set up Databricks with my AWS account but I am facing some issues, I followed the steps to create a new Databricks workspace using the AWS CloudFormation template or Databricks setup guide, But the CloudFormation stack fails every time...

  • 467 Views
  • 1 replies
  • 0 kudos
Latest Reply
Advika
Databricks Employee
  • 0 kudos

Hello @dipin_wantoo! Can you please check the CloudFormation Stack Events for the exact error? That should help identify why the stack is failing. If you're looking to get started with Databricks as an individual user, the Express Setup is a simple w...

  • 0 kudos
AlexMc
by New Contributor III
  • 1340 Views
  • 3 replies
  • 1 kudos

Library installation failed for library due to user error for pypi

Hi!I get the below error when a cluster job starts up and tries to install a Python .whl file. (Which is hosted on an Azure Artefact feed, though this seems more like a problem of trying to read from a disk/network storage). The failure is seemingly ...

  • 1340 Views
  • 3 replies
  • 1 kudos
Latest Reply
AlexMc
New Contributor III
  • 1 kudos

Thanks both - I think the problem is that this library installation is called when creating a new Job & Task via the rest endpoint. Where the libraires are specified in the .json file. So short version, don't think I can 'get at' the pip install call...

  • 1 kudos
2 More Replies
Dnirmania
by Contributor
  • 3087 Views
  • 1 replies
  • 0 kudos

Unable to destroy NCC private endpoint

Hi TeamAccidentally, we removed one of the NCC private endpoints from our storage account that was created using Terraform. When I tried to destroy and recreate it, I encountered the following error. According to some articles, the private endpoint w...

  • 3087 Views
  • 1 replies
  • 0 kudos
Latest Reply
Vidhi_Khaitan
Databricks Employee
  • 0 kudos

  Once a private endpoint rule is deactivated, it isn't immediately removed. Instead, it will be scheduled for purging after a set time period. In your case, the rule is slated for purging at the timestamp mentioned. This situation can occur in scena...

  • 0 kudos
SBL
by Contributor
  • 1737 Views
  • 2 replies
  • 1 kudos

Resolved! Why am I seeing NAT Gateway in the cost? Serverless Compute.

I have Azure Databricks premium subscription. I am running the Python interactive Notebooks in the Databricks Wokrspace using Serverless compute since the last few days. Today I received an alter in my email saying the monthly Billing already crossed...

NAT Gateway.png
  • 1737 Views
  • 2 replies
  • 1 kudos
Latest Reply
SBL
Contributor
  • 1 kudos

Thanks @szymon_dybczak I deleted the Workspace and the NAT Gatway service got deleted from the vnet. I created a simple single node cluster to run my code. 

  • 1 kudos
1 More Replies
philmac750
by New Contributor III
  • 1294 Views
  • 1 replies
  • 0 kudos

Resolved! Can I add another user to Free edition

Is it possible to add another user to Free edition ?I am wanting to test what they can see when they connect as a restricted user i.e. only granted Browse on 1 catalogThanks

  • 1294 Views
  • 1 replies
  • 0 kudos
Latest Reply
philmac750
New Contributor III
  • 0 kudos

Apologies.  Yes you can - I was in the wrong console.

  • 0 kudos
Charansai
by New Contributor III
  • 3246 Views
  • 7 replies
  • 0 kudos

Failing PowerBi connection with data Bricks via SQL warehouse

  I'm encountering an 'Invalid credentials' error (Session ID: 4601-b5a6-0daf792752a2, Region: us) when connecting Power BI to an Azure Databricks SQL Warehouse using an SPN. The SPN has CAN MANAGE access at SQL warehouse, admin rights at account and...

SaiChandu_2-1752261722144.png
  • 3246 Views
  • 7 replies
  • 0 kudos
Latest Reply
Khaja_Zaffer
Contributor III
  • 0 kudos

Hello sai, sorry for the experience   I usually available at desk during EMEA time zone. Apologies for the delay. Can you please try this?In "Advanced settings" of the data source within the gateway configuration and set the "Connection Encryption se...

  • 0 kudos
6 More Replies
Isi
by Honored Contributor III
  • 5836 Views
  • 6 replies
  • 3 kudos

Unable to access Databricks Volume from job triggered via API (Container Services)

Hi everyone,We’re facing a strange issue when trying to access a Databricks Volume from a job that is triggered via the Databricks REST API (not via Workflows). These jobs are executed using container services, which may be relevant, perhaps due to i...

  • 5836 Views
  • 6 replies
  • 3 kudos
Latest Reply
Octavian1
Contributor
  • 3 kudos

Check also whether the cluster used to run the job has the right access to the specific UC Volume.

  • 3 kudos
5 More Replies
yavuzmert
by New Contributor II
  • 1383 Views
  • 2 replies
  • 1 kudos

Unity Catalog system tables (table_lineage, column_lineage) not populated

Hi community,We have enabled Unity Catalog system schemas (including `access`) more than 24 hours ago in sandbox. The schemas are showing ENABLE_COMPLETED, and other system tables (like query) are working fine.However, both `system.access.table_linea...

  • 1383 Views
  • 2 replies
  • 1 kudos
Latest Reply
zumsted
New Contributor II
  • 1 kudos

I'm also running into a similar issue where our system.access.column_lineage and system.access.table_lineage tables are no longer visibile.

  • 1 kudos
1 More Replies