What's the challenge Build a Databricks App on Free Edition with a Genie Agent at its core. Build a Databricks App, create and configure your own Genie Agent, connect it to your App, and use it to power a meaningful, useful, or unexpected experienc...
- 2199 Views
- 10 replies
- 9 kudos
a week ago
Databricks EMEA Learning Festival Hands On Virtual Training 29–30 September 2026 · 09:00 BST / 10:00 CEST · Fully virtual · Free to join Ready to accelerate your journey on Data & AI? Join us for the EMEA Learning Festival. A two-day, hands-on vir...
- 1420 Views
- 0 replies
- 1 kudos
2 weeks ago
Congratulations to all members who have received the new Databricks Partner badge! Your badge recognizes your affiliation with the Databricks Partner ecosystem and helps community members quickly identify trusted partner professionals across discuss...
- 5202 Views
- 47 replies
- 10 kudos
a month ago
Our Community Champion Program has always been about recognizing individuals who consistently show up to support others, share their expertise, and strengthen the Databricks Community. Alongside our customers, we’re equally proud to recognize the inc...
- 1536 Views
- 4 replies
- 6 kudos
2 weeks ago
Manufacturers collect large volumes of sensor and equipment data, but measuring equipment productivity at the required latency and scale can be difficult with traditional systems. The Overall Equipment Effectiveness (OEE) Solution Accelerator demonst...
- 303 Views
- 0 replies
- 1 kudos
a week ago
The Weekly Digest • August 17 – 23 Community Pulse Big ideas, sharp answers, and the threads everyone's talking about. Let's dig in. This Week's Community Stars The folks who showed up, pitched in, and made it count this week : @ShamenParis...
- 177 Views
- 0 replies
- 2 kudos
Tuesday
Community Activity
- 228 Views
- 3 replies
- 2 kudos
Resolved! Excel Add-in Regression - Sign-in opens external browser window instead of embedding in task pane, r
Issue: The Databricks Excel Add-in launches authentication in an external browser window rather than within the Excel task pane. The Unity Catalog does display in the external browser window, but after sign-in, Excel remains stuck spinning/loading in...
- 228 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
Worked with Databricks support engineers to resolve. Root cause determined to be that while the Marketplace add-in previously allowed the connection to be made to the workspace URL, it no longer does. Resolution was to remove the Marketplace add-in...
- 2 kudos
- 147 Views
- 2 replies
- 1 kudos
Possible Incorrect Answer Marking in Databricks Academy Assessment - Agent Evaluation on Databricks
Hello All,I would like to report what appears to be an issue with one of the assessment questions in the Evaluating AI Agents course - Generative AI Engineer Pathway.Question:According to the lecture on evaluating AI agents, which of the following is...
- 147 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
@Advika i have raised the same, acknowlegded as below Hi Dhivakar, Thanks for contacting the Databricks Training team. Your request #00995431 has been received. We are looking into your question regarding Possible Incorrect Answer Marking in Databri...
- 1 kudos
- 15 Views
- 0 replies
- 0 kudos
Model Serving An internal error occurred during feature store lookup all deploys failing
We can't deploy models to Model Serving. Failures started around 2026-08-16 and were intermittent at first — our current production config deployed cleanly on 08-20 — but since then every attempt fails at the feature store lookup setup step, with no ...
- 15 Views
- 0 replies
- 0 kudos
- 33 Views
- 2 replies
- 1 kudos
Suggestions for recommendation
Hey everyone! I’m currently looking for some good tools for data analysis. If you have any recommendations, please share them with me. Would really appreciate it!
- 33 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
@ThiamLee You can use Notebooks that let you write Python and SQL code interactively. You use libraries like pandas, matplotlib, ydata profiling and Py Spark for both small and large-scale analysis in it. Databricks SQL provides a dedicated SQL edito...
- 1 kudos
- 271 Views
- 4 replies
- 2 kudos
Is the Semantic Layer the Real Challenge With Databricks Genie?
I've been thinking about this while looking at different Genie use cases.It seems like the hardest part of implementing Genie isn't getting users to ask questions in natural language. It's making sure Genie understands what those questions actually m...
- 271 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
language interface itself. Genie can generate SQL, but it still needs clear business definitions, relationships, metrics, and terminology to know what the user actually means. Databricks itself recommends well-documented datasets, SQL expressions, ex...
- 2 kudos
- 15 Views
- 0 replies
- 1 kudos
Le Greffier - A Genie Agent Powered Game
In 1929 a Catholic theologian wrote ten rules for detective fiction. Ronald Knox was only half serious. He and Chesterton and Sayers had a dining club for writers of detective fiction and the rules were closer to a party game than a manifesto, but th...
- 15 Views
- 0 replies
- 1 kudos
- 240 Views
- 4 replies
- 2 kudos
Oracle CDC Ingestion Pipeline - Schema Exploration finds 0 tables when DB_DOMAIN
Hi,I'm setting up an Oracle Integrated CDC Managed Ingestion Pipeline (LakeFlow Connect) on Azure Databricks. The pipeline connects to Oracle 19c successfully but Schema Exploration always returns 0 tables.Error:Schema Exploration has COMPLETED in 5 ...
- 240 Views
- 4 replies
- 2 kudos
- 94 Views
- 3 replies
- 4 kudos
Landing Layer vs. Bronze Layer — When to Use Which?
I’ve seen two common approaches in data architectures:Landing → Bronze: Raw files are first dumped into a landing layer, archived, and then loaded into Delta tables as Bronze.Raw files = Bronze: The raw file dump itself is treated as the Bronze laye...
- 94 Views
- 3 replies
- 4 kudos
Latest Reply
- 4 kudos
The choice mainly depends on replay, audit, and governance needs. If you need a reliable source of truth for reprocessing, keep raw files separate from Bronze. Otherwise, treating raw files as Bronze can reduce storage, cost, and complexity. Make the...
- 4 kudos
- 20167 Views
- 10 replies
- 7 kudos
set PYTHONPATH when executing workflows
I set up a workflow using 2 tasks. Just for demo purposes, I'm using an interactive cluster for running the workflow. { "task_key": "prepare", "spark_python_task": { "python_file": "file...
- 20167 Views
- 10 replies
- 7 kudos
Latest Reply
- 7 kudos
We’re facing the same issue while trying to implement Databricks Asset Bundles (DAB).We’ve checked multiple possibilities, and it looks like packaging the code as a wheel or using `sys.path.append` are the only viable options.It looks like Databricks...
- 7 kudos
- 230 Views
- 3 replies
- 5 kudos
Productionizing Databricks Pipelines with Declarative Automation Bundles and Azure DevOps
A retail medallion pipeline packaged as a bundle, promoted through Dev, QA, and Production from a single repository — including the deployment-mode bug that made every stage go green while shipping a job that could never have run.Most Databricks proj...
- 230 Views
- 3 replies
- 5 kudos
Latest Reply
- 5 kudos
@Isaac_18 wrote:For production, deploy to a shared location and run as a service principal.Doing this will give you a warning on the deployment as it will grant everyone read/write access to the underlying assets. Warning: the bundle root path /Works...
- 5 kudos
- 13293 Views
- 12 replies
- 10 kudos
Resolved! What are powerfull data quality tools/libraries to build data quality framework in Databricks ?
Dear Community Experts,I need your expert advice and suggestions on development of data quality framework. What are powerfull data quality tools or libraries are good to go for development of data quality framework in Databricks ? Please guide team.R...
- 13293 Views
- 12 replies
- 10 kudos
Latest Reply
- 10 kudos
I have used Databricks labs - DQX for a failrly complex data quality implementation and it handlled the mix of built in validations and custom business rules well. One thing we learned is that performance depended much more on the underlying data lay...
- 10 kudos
- 51 Views
- 0 replies
- 0 kudos
Insights Requested: Databricks Certified Data Engineer Associate Exam Experience & PatternComplexity
Hello everyone, I would like to understand Databricks Certified Data Engineer Associate exam and would greatly appreciate insights from anyone who has recently taken it. Specifically, I am looking to understand:Scenario-Based Questions: What types of...
- 51 Views
- 0 replies
- 0 kudos
- 264 Views
- 3 replies
- 5 kudos
Resolved! Auto SCD API Tombstone Garbage Collection
Are there any settings that can be used to influence the frequency at which the auto SCD API runs the tombstone garbage collection process in Spark Declarative Pipelines? I've seen a couple community posts that referenced the following: pipelines.a...
- 264 Views
- 3 replies
- 5 kudos
Latest Reply
- 5 kudos
I was able to get this figured out. The setting that works is pipelines.applyChanges.tombstoneGCFrequencyInSeconds, and it seems like it can be set as either a pipeline configuration or in the spark conf of the individual streaming table(either in c...
- 5 kudos
- 72 Views
- 0 replies
- 2 kudos
Understanding Lakebase branching
I've been playing with Databricks Lakebase lately and I'm impressed by some of the features that come with it. I mean, you can sync data from a Lakehouse to Lakebase (OLAP to OLTP) and vice versa using Lakebase CDF. But most importantly, I'm impresse...
- 72 Views
- 0 replies
- 2 kudos
- 98 Views
- 1 replies
- 1 kudos
Title: Oracle CDC pipeline (Lakeflow Connect) never terminates
Setup: Oracle 21c XE (CDB/PDB), Direct CDC Extraction, no gateway, triggered pipeline on hourly schedule, single table.Problem: A triggered run has been active 95+ minutes with no work left. All flows report IDLE, waiting for new data, the source is ...
- 98 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Just a small question to understand more : are you using any community connector or specific method to connect ?
- 1 kudos
Announcements
| User | Count |
|---|---|
| 2290 | |
| 1360 | |
| 1251 | |
| 1184 | |
| 961 |
Latest from our Blog
Building an Autonomous Supply Chain Engine on Databricks
The Trillion $ shift Supply Chains aren't ready for Gartner predicts that by 2028, 90% of B2B buying will be AI agent intermediated, pushing over $15 trillion of B2B spend through AI agent exchanges. ...
Identity Columns Best Practices for Databricks Lakehouse
The surrogate key problem nobody plans for Sooner or later every data warehouse needs surrogate keys. You are building a dimension table and you want a single narrow column your fact tables can join o...
DABs Migration Guide: Terraform to the Direct Deployment Engine
This guide covers the migration procedure and several behaviors worth knowing that this migration surfaced in practice. Background and timeline The deployment backend for DABs is moving from the Terra...
Beyond Prompting: Production-Ready Image Generation and Visual Asset Management on Databricks
Image Generation in the Enterprise For agencies, creative studios, retailers, and media companies, visual assets are core to the business. Better image generation can directly improve output, speed, a...
