cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

eric-c
by New Contributor II
  • 1674 Views
  • 2 replies
  • 1 kudos

Alert ACL's not available

The list of available ACL's for alerts suggests there's a way to set "can run" and "can manage" permissions but neither the REST API nor the Databricks CLI show options for setting permissions. Is there a way to set acl's on alerts? If so, how?Alert ...

  • 1674 Views
  • 2 replies
  • 1 kudos
Latest Reply
eric-c
New Contributor II
  • 1 kudos

Thanks @Walter_C  Looks like that api is deprecated now. Here's the latest one: Set workspace object permissions | Workspace API | REST API reference | Databricks on AWS

  • 1 kudos
1 More Replies
rpl
by Contributor
  • 8391 Views
  • 15 replies
  • 2 kudos

Resolved! Which API to use to list groups in which a given user is a member

Is there an API that can be used to list groups in which a given user is a member? Specifically, I’d be interested in account (not workspace) groups.It seems there used to be a workspace-level list-parents API referred to in the answers to this quest...

  • 8391 Views
  • 15 replies
  • 2 kudos
Latest Reply
noorbasha534
Valued Contributor II
  • 2 kudos

there will be 2 system tables soon - users, groups. Probably, that makes life easy. I have already requested the Databricks RAS meant for my customer to enabled these for our control plane

  • 2 kudos
14 More Replies
arun_prakash
by New Contributor
  • 2432 Views
  • 4 replies
  • 0 kudos

Databricks Apps not working in postman

I have a question regarding Databricks Apps. I have deployed my databricks Apps, and its working on my laptop, but when I try to open the same url in my mobile its redirecting to databricks signin page, and also its not working through postman as wel...

  • 2432 Views
  • 4 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

Is this issue specifically with the Databricks Apps am I right? Are you getting and erro message?

  • 0 kudos
3 More Replies
lion_king_84
by New Contributor III
  • 1489 Views
  • 2 replies
  • 0 kudos

Resolved! Azure Databricks - Exporting data frame to external volume

Hello,I am reading a Delta table and exporting it to an external volume. The Unity Catalog external volume points to an Azure Data Lake Storage container.When I run the code below, I encounter the error message shown below. (When I export the data to...

  • 1489 Views
  • 2 replies
  • 0 kudos
Latest Reply
saurabh18cs
Honored Contributor III
  • 0 kudos

Hi @lion_king_84 are we missing write volume permissions on this schema in UC?

  • 0 kudos
1 More Replies
Thabang
by Databricks Partner
  • 2495 Views
  • 3 replies
  • 2 kudos

Resolved! Databricks Networking

Currently our workspace has almost reached its maximum IP capacity, and we would like to create additional compute resources to handle memory intensive tasks. In doing some research we have been running into some conflicting answers, so I wanted to a...

  • 2495 Views
  • 3 replies
  • 2 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 2 kudos

Greeting @Thabang , I did some digging and there are potential mitigation paths, but they’re fairly involved and not something you’d want to tackle solo. The guidance consistently points to engaging Support—you’ll definitely need their help to do thi...

  • 2 kudos
2 More Replies
johnb1
by Contributor
  • 9663 Views
  • 12 replies
  • 4 kudos

Resolved! Deploy Workflow only to specific target (Databricks Asset Bundles)

I am using Databricks Asset Bundles to deploy Databricks workflows to all of my target environments (dev, staging, prod). However, I have one specific workflow that is supposed to be deployed only to the dev target environment.How can I implement tha...

  • 9663 Views
  • 12 replies
  • 4 kudos
Latest Reply
Pat
Esteemed Contributor
  • 4 kudos

I know it's a bit old, but if someone is looking into a solution, then I was able to resolve the issue where I need to deploy some jobs only into the DEV target:https://github.com/databricks/bundle-examples/tree/main/knowledge_base/target_includes.Us...

  • 4 kudos
11 More Replies
Harish_Kumar_M
by New Contributor
  • 1034 Views
  • 1 replies
  • 2 kudos

Resolved! Databricks Asset Bundles Issue

Hi All,We are trying to update an existing job with some additional configurations. We are trying to deploy the new changes to the job using the DABs process. We have mentioned the job_id and job_name variables and defined them as well.Pipeline state...

  • 1034 Views
  • 1 replies
  • 2 kudos
Latest Reply
Pat
Esteemed Contributor
  • 2 kudos

Hi @Harish_Kumar_M ,Databricks Asset Bundles (DABs) require binding to existing workspace resources like manually created jobs before updates will reflect during deployment. https://docs.azure.cn/en-us/databricks/dev-tools/bundles/migrate-resourcesYo...

  • 2 kudos
pppp
by New Contributor II
  • 1269 Views
  • 2 replies
  • 3 kudos

Resolved! timeout for sessions made with sdk

How do I determine the rules for when a session will timeout? From testing it seems to be related to inactivity. I am using JavaScript SDK and I want to test my logic for creating a new session when the current one times out based on this issue: http...

  • 1269 Views
  • 2 replies
  • 3 kudos
Latest Reply
pppp
New Contributor II
  • 3 kudos

seems to be timing out after 15 min of inactivity

  • 3 kudos
1 More Replies
MadMax_71_2
by New Contributor II
  • 887 Views
  • 2 replies
  • 0 kudos

Resolved! Lineage & Query history table

Hi,I’m trying to perform a join between the Lineage and Query History system tables. Initially, I assumed statement_id could be used as the join key, but that didn’t seem correct. I then noticed that joining statement_id with entity_run_id also appea...

  • 887 Views
  • 2 replies
  • 0 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 0 kudos

Hi @MadMax_71_2 ,Check ERD diagram. Here you should find what's the correct key:docs.databricks.com/aws/en/assets/images/system-tables-erd-690b80220d077015a023f90d59ff7560.svg

  • 0 kudos
1 More Replies
Seunghyun
by Contributor
  • 1578 Views
  • 5 replies
  • 3 kudos

Resolved! Questions regarding catalogs starting with __databricks_internal_catalog

Hello,I am a Data Engineer currently building a data platform in a Databricks-AWS environment.While querying system.information_schema.catalog_privileges, I noticed several catalogs starting with __databricks_internal_catalog. Specifically, there are...

  • 1578 Views
  • 5 replies
  • 3 kudos
Latest Reply
Seunghyun
Contributor
  • 3 kudos

Thanks for everybody!!@stbjelcevic @Sumit_7 

  • 3 kudos
4 More Replies
Drew_Prof
by New Contributor II
  • 1898 Views
  • 3 replies
  • 2 kudos

Resolved! College Course Use - Sharing Data With Students

Hello Everyone,I am creating a new college course on Database design and SQL analytics and have decided to use Databricks as our platform in the course.  We are going to be using the Free Edition so students do not need to pay for access.  I'm wonder...

  • 1898 Views
  • 3 replies
  • 2 kudos
Latest Reply
Drew_Prof
New Contributor II
  • 2 kudos

Excellent information, thank you!  The data generator was something I was not aware of so I will check that out.

  • 2 kudos
2 More Replies
flynnpham920
by New Contributor II
  • 2030 Views
  • 2 replies
  • 3 kudos

Resolved! Communication between two workspaces

Hi everyone, our team is implementing an application utilizing the Databricks App (in AzureDatabricks) to deploy a website in workspace A (sea). This web calls an API to the Databricks Dashboards in workspace B (jpe) to get a token to embed the dashb...

  • 2030 Views
  • 2 replies
  • 3 kudos
Latest Reply
nayan_wylde
Esteemed Contributor II
  • 3 kudos

The specific error message is a known symptom of Databricks network-policy enforcement for cross-workspace calls, not (only) an OAuth/service-principal problem.403 Cert validation failed. Both workspace comparison and snp system trusted checks did no...

  • 3 kudos
1 More Replies
imbrigliaf
by New Contributor II
  • 739 Views
  • 1 replies
  • 2 kudos

Resolved! Company card / billing in Databricks express setup

For Databricks express setup only, is there a way to add company's VAT number, name and address during (or after) the "add a payment method" form, in order to receive a valid company's billing document from Databricks?

  • 739 Views
  • 1 replies
  • 2 kudos
Latest Reply
pradeep_singh
Honored Contributor III
  • 2 kudos

I dont thing this can be done. You can check with Tech support as well . https://help.databricks.com/

  • 2 kudos
Teo12333
by New Contributor II
  • 5509 Views
  • 2 replies
  • 0 kudos

How do I get rid of the GKE cluster?

hi!In our organisation we use databricks but I do not understand why this GKE cluster keeps getting created. We deploy workspaces and compute clusters through terraform and use the GCE tag"x-databricks-nextgen-cluster" = "true"From my understanding, ...

  • 5509 Views
  • 2 replies
  • 0 kudos
Latest Reply
Korakot
Databricks Partner
  • 0 kudos

Hello @Louis_Frolio I would like to confirm my understanding regarding cost attribution for workloads running on Next-Gen / Serverless / Ephemeral Compute that are tagged withx-databricks-nextgen-cluster = "true".Is it correct that, in this case, the...

  • 0 kudos
1 More Replies
fgeriksen
by New Contributor II
  • 1104 Views
  • 3 replies
  • 1 kudos

Resolved! Enabling External Lineage on a free or trial account?

Hi,as part of a small OSS project I am doing, dbt-unity-lineage, I need to enable Bring your own data lineage (Public Preview as of December 2025). But it seems you can't enable that Preview in either free edition or Trial?I'd rather not use my emplo...

Administration & Architecture
dbt
dbt GA PublicPreview
  • 1104 Views
  • 3 replies
  • 1 kudos
Latest Reply
Louis_Frolio
Databricks Employee
  • 1 kudos

@fgeriksen , if you are satisfied with the response please "Accept as Solution" so that others will be informed as well.  Cheers, Louis.

  • 1 kudos
2 More Replies