cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

mariajsm
by Visitor
  • 60 Views
  • 0 replies
  • 0 kudos

Who pays cross-cloud egress for Delta Sharing from GCP to Azure?

Hi DBX community!! Are cross-cloud egress charges for a Databricks-to-Databricks #DeltaShare billed to the provider account, and do they apply when the shared objects are views backed by Cloudflare?I'm setting up a Delta Share using Databricks on GCP...

Administration & Architecture
cloudflare
cross cloud
delta share
egress
open share
  • 60 Views
  • 0 replies
  • 0 kudos
AndreiaC
by New Contributor II
  • 100 Views
  • 3 replies
  • 0 kudos

Private listing of App Asset in Databricks Marketplace by 3rd Party Provider

Hello, Could you help confirm whether a third-party provider is able to publish an App asset type as a private listing within a Private Exchange?If this is supported, is it a self-service capability, or does it need to be enabled per account? And if ...

  • 100 Views
  • 3 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 0 kudos

@AndreiaC Databricks Apps are currently not supported as an asset type in Databricks Marketplace. While Marketplace supports data assets, tables, views, volumes, notebooks, machine learning models and MCP servers (Preview), Apps operate under a diffe...

  • 0 kudos
2 More Replies
nafikazi
by Contributor
  • 408 Views
  • 2 replies
  • 2 kudos

Resolved! Estimating Databricks Annual Implementation and Licensing Costs in 2026

 Hello everyone,Good evening. I am a data analyst and a Databricks Certified Data Engineer Associate. While I understand the platform from a technical perspective and recognize its value, I am still learning how to estimate the full financial impact ...

  • 408 Views
  • 2 replies
  • 2 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 2 kudos

@nafikazi  The framework you mapped out demonstrates a good understanding of how decisions dictate operational spend. Structuring the model around Year 1 implementation versus steady-state run rates, defining capacity tiers by team profile and establ...

  • 2 kudos
1 More Replies
amitsharma1707
by Databricks Partner
  • 336 Views
  • 1 replies
  • 1 kudos

Resolved! Microsoft Fabric One and Databricks Unity Catalog — Bidirectional Access Without Data Movement

Hi everyone,We're working in a hybrid environment with both Microsoft Fabric and Databricks, and I want to understand the options for virtualizing data between the two platforms without physically moving or duplicating it — similar to how shortcuts w...

  • 336 Views
  • 1 replies
  • 1 kudos
Latest Reply
kartikchoudhary
New Contributor III
  • 1 kudos

One thing I'd evaluate before choosing between virtualization and replication is the ownership model.If Fabric and Databricks both need to operate on the same data, I'd look at four areas: authentication, governance/permissions, Delta feature compati...

  • 1 kudos
vkondepati
by Databricks Partner
  • 600 Views
  • 4 replies
  • 1 kudos

Resolved! Unity Catalog Metric Views to be accessible to Custom Apps outside of DBX environment

Hello Everyone,We have a requirement to expose Databricks Unity Catalog Metric Views to custom applications running outside the Databricks environment.The application team would like to consume governed KPIs and metrics through APIs such as REST or G...

  • 600 Views
  • 4 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @vkondepati ,Hi  ,Hi,1. Out-of-the-box REST/GraphQL for metric views?Databricks does not appear to provide a Metric View-specific REST or GraphQL query API. Metric Views are queried through the Databricks SQL engine using SQL, including the MEASUR...

  • 1 kudos
3 More Replies
Darshanrawal971
by New Contributor
  • 570 Views
  • 2 replies
  • 0 kudos

How is Serverless Compute implemented under the hood?

Hi everyone,I've been reading about Serverless Compute and have a question about the underlying architecture.In the classic compute model, clusters are provisioned in the customer's cloud account. With Serverless, Databricks manages the compute, but ...

  • 570 Views
  • 2 replies
  • 0 kudos
Latest Reply
ShamenParis
Contributor III
  • 0 kudos

Hi @Darshanrawal971 Great question! To understand how Serverless works under the hood, it helps to break it down into two main concepts: Warm Pools and Secure Networking.1. How Databricks manages the Compute (Warm Pools)Instead of spinning up new Vir...

  • 0 kudos
1 More Replies
LeandroVeiga10
by New Contributor II
  • 788 Views
  • 2 replies
  • 0 kudos

Databricks Free Edition – No Workspace Available

Hello Databricks Community,I recently created a Databricks Free Edition account. Although my account is active and I can sign in successfully, no workspace is available. The account console displays the following message: â€œYou are not a member of any...

  • 788 Views
  • 2 replies
  • 0 kudos
Latest Reply
balajij8
Esteemed Contributor II
  • 0 kudos

Hi LeandroVeiga10, This issue is affecting the Free Edition in certain areas. Create a new Free Edition account and select the Singapore region instead of the US or your default region during sign-up. You should be able to complete your studies and w...

  • 0 kudos
1 More Replies
yyonm
by New Contributor III
  • 1355 Views
  • 3 replies
  • 3 kudos

Resolved! Zerobus ingestion fails in Databricks Free Edition using Service Principal OAuth

Hi everyone!.I developed a Python producer that sends asynchronous dummy messages to Zerobus. I tested it in the Databricks workspace I use at work, and everything worked as expected. The messages were successfully ingested, and I was able to verify ...

  • 1355 Views
  • 3 replies
  • 3 kudos
Latest Reply
iyashk-DB
Databricks Employee
  • 3 kudos

Hi, it's worth verifying the exact Unity Catalog permissions before concluding that this is purely an edition limitation. Zerobus specifically requires the following grants: GRANT USE CATALOG ON CATALOG <catalog> TO `<service-principal-id>`; GRANT US...

  • 3 kudos
2 More Replies
pragya17s
by New Contributor II
  • 776 Views
  • 1 replies
  • 0 kudos

Guidance Needed on Publishing a Databricks App to the Databricks Marketplace

Hi everyone,We are a Databricks Partner now and Salesforce Partner with over 15 years of experience. We have developed a Databricks App using Free Edition and seek for publication of our App on the Databricks Marketplace. We would appreciate guidance...

  • 776 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @pragya17s, I have just responded to your other post asking the same question. If you want to publish through Databricks Marketplace, you should plan around a paid Databricks environment rather than Free Edition. The Marketplace provider requireme...

  • 0 kudos
Swapnil-sriv
by New Contributor
  • 372 Views
  • 1 replies
  • 0 kudos

Do databricks partners need to pay for databricks account?

Hi guys,Our company is new to databricks and we want to become marketplace provider, so for that we have become databricks partner.and now that we want to develop our app/accelarator that we will put on databricks marketplace, do we need to get a pai...

  • 372 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @Swapnil-sriv, Not a stupid question at all... It's a reasonable question when you're new to Databricks Marketplace. If your goal is to become a Databricks Marketplace provider and publish your own app or accelerator, a Free Edition account is gen...

  • 0 kudos
ss6
by New Contributor II
  • 609 Views
  • 1 replies
  • 0 kudos

Account does not exists error

I am writing to request assistance with a login issue I am experiencing with Databricks.I am attempting to create a Databricks account on AWS using my email address. Although I already have an active AWS account associated with this email, I am unabl...

ss6_3-1782414727390.png ss6_4-1782414762504.png ss6_5-1782414833572.png ss6_6-1782414887854.png
  • 609 Views
  • 1 replies
  • 0 kudos
Latest Reply
emma_s
Databricks Employee
  • 0 kudos

Hi, For this kind of issue you should email onboarding-help@databricks.com with your account details and they should be able to help. You should have received an onboarding email, which you would have needed to accept before the workspace setup. If y...

  • 0 kudos
158576
by New Contributor
  • 646 Views
  • 2 replies
  • 0 kudos

mount cifs volume on all purpose compute results in permission denied

I have all networking already set, nslookup resolves NAS server IP and connectivity is enabled from worker nodes to nas server. I am able to mount the same nas drive outside of databricks, I mean standalone linux vm in the same VPC where worker nodes...

  • 646 Views
  • 2 replies
  • 0 kudos
Latest Reply
Ashwin_DSA
Databricks Employee
  • 0 kudos

Hi @158576, Sorry for the delay in getting back to you, and just closing the loop in case you’re still expecting an answer. Thanks for sharing the details. Based on what you’ve already validated, this does not sound like a basic networking problem. I...

  • 0 kudos
1 More Replies
yustus
by New Contributor III
  • 1058 Views
  • 2 replies
  • 2 kudos

Resolved! API - Service Principle Secret Generation

Hi everyone,I am looking for a way to automatically create service principals, including their secrets, for M2M OAuth.I know that service principals can be created via the API, but it seems that creating secrets for those service principals via the A...

  • 1058 Views
  • 2 replies
  • 2 kudos
Latest Reply
ShamenParis
Contributor III
  • 2 kudos

Hi @yustus It’s great that you are prioritizing secure M2M OAuth over OBO tokens!while @szymon_dybczak already mentioned the Python SDK and Terraform, I wanted to offer a few alternative approaches depending on how your automation is set up:1. The Di...

  • 2 kudos
1 More Replies
dkxxx-rc
by Contributor
  • 914 Views
  • 2 replies
  • 1 kudos

Resolved! Work-around for cloning a repo with notebooks too big

Hi,It would be nice to be able to clone https://github.com/shap/shap into Databricks, it being such a standard.  But it fails because some of the notebooks violate a Databricks size limit.  Using sparse clone mode I can force my way through getting m...

  • 914 Views
  • 2 replies
  • 1 kudos
Latest Reply
dkxxx-rc
Contributor
  • 1 kudos

This looks sufficient, thanks.  I was able to run a clone in the CLI.  The folder ends up in an invalid git state, but that appears to be because the beta feature isn't turned on for my workspace yet.

  • 1 kudos
1 More Replies
lkahn
by New Contributor II
  • 990 Views
  • 2 replies
  • 0 kudos

Resolved! UI issue with R plots

Starting on May 6, our workspace in ap-southeast-2 stopped being able to display R plots correctly. This is specific to this workspace (we have 3), and specific to R plots, and is occurring for all users and clusters.The figure itself can be resized ...

  • 990 Views
  • 2 replies
  • 0 kudos
Latest Reply
Lu_Wang_ENB_DBX
Databricks Employee
  • 0 kudos

This looks like a workspace-side notebook UI regression.  Recommendation Open a Databricks support ticket and treat it as a Notebook UI / rendering regression for that workspace. Include: Workspace IDRegion: ap-southeast-2Start date: May 6A notebook...

  • 0 kudos
1 More Replies