Hey Databricks Community! Join us for a free community-sponsored BrickTalk where we’ll explore Multi-Cloud Data Sharing with OpenSharing SecureConnect & Global Distribution. BrickTalks is a community event series where Databricks experts share real-w...
- 166 Views
- 0 replies
- 0 kudos
yesterday
NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...
- 3098 Views
- 1 replies
- 1 kudos
3 weeks ago
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 2351 Views
- 0 replies
- 2 kudos
3 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 4538 Views
- 0 replies
- 4 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 1411 Views
- 0 replies
- 1 kudos
3 weeks ago
Predicting patient disease risk and measuring quality of care are important to precision health. This Solution Accelerator demonstrates a machine learning workflow using healthcare data to identify clinical and demographic factors associated with dis...
- 75 Views
- 0 replies
- 0 kudos
yesterday
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 1001 Views
- 0 replies
- 4 kudos
a month ago
Community Activity
- 32 Views
- 1 replies
- 0 kudos
Genie agents and Unity Catalog wikis: what I tested, and what to use instead
I tested whether a Genie agent picks up a business rule from a Unity Catalog wiki (Beta). Short answer: not today. A Genie agent works from the data, the table and column comments, and the context you configure in the agent. Here's the test and what ...
- 32 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Really useful test, especially the revenue example. It highlights an important gap between documenting business rules and making sure Genie actually follows them. I agree that metric views are a much better approach for defining reusable business log...
- 0 kudos
- 95 Views
- 2 replies
- 2 kudos
Serverless declarative pipeline ingestion from ADLS is running x4 SLOWER randomly
Hi all,A full refresh of one Auto Loader streaming table in a serverless #Lakeflow (Declarative) pipeline has become about 4x slower (all to do with a single streaming table), and I'd like help understanding why. Nothing on our side changed. The onl...
- 95 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Hello @rjmcbride, I took a look at both internal and external documentation and here is what I found. This is one of the cleaner performance writeups I’ve seen on here. Same files, same code, same options, one variable changed, and both runs measured...
- 2 kudos
- 33 Views
- 0 replies
- 0 kudos
Unity Catalog secrets: what each grant does, and the schema-level READ SECRET that fails
I tested Unity Catalog secrets in my own Azure Databricks sandbox (serverless, environment version 6) to see what each privilege actually lets a service principal do. Most of it matches the docs. One thing doesn't: READ SECRET can't be granted on a s...
- 33 Views
- 0 replies
- 0 kudos
- 1782 Views
- 23 replies
- 8 kudos
MS Fabric Direct Lake, works with delta tables only?
Lately we started using Direct Lake to use the results of our ingestion pipelines (gold tables) in PBI dashboards. This is working ok but has one annoying and troublesome issue. Which is: the gold tables are the end result of declarative pipelines so...
- 1782 Views
- 23 replies
- 8 kudos
Latest Reply
- 8 kudos
Hi @dbernstein_tp,Thanks for testing all of that and reporting back. Good to know deletion vectors didn't upset Direct Lake.I think your two findings are really the same problem. If most of the gold MVs are fully recomputed on every update, each refr...
- 8 kudos
- 727 Views
- 10 replies
- 14 kudos
How to Connect Databricks to Snowflake & Query Live Data?
Hi everyone,I am looking for a method to connect Databricks to Snowflake so I can query and transform the data directly in a notebook. I specifically want to avoid methods that just perform a one-time copy of the tables into Databricks, as I need the...
- 727 Views
- 10 replies
- 14 kudos
Latest Reply
- 14 kudos
Hey @Raj_DB, good follow-up, and the short answer is yes. Same auth method, no changes to the connection syntax. Key-pair auth in Snowflake is attached to a Snowflake user, and nothing says that user has to be a human. The clean pattern is a dedicate...
- 14 kudos
- 82 Views
- 0 replies
- 0 kudos
Reinforcement Learning on Databricks: Building a Contextual Bandit
Is MLflow really built only for supervised learning, or can it handle something like reinforcement learning? A customer asked me exactly this. They're running a contextual-bandit-style system on-premises and are thinking about moving it to the cloud ...
- 82 Views
- 0 replies
- 0 kudos
- 304 Views
- 4 replies
- 3 kudos
Databricks exam got suspended. Need urgent help
Hello Team, I faced multiple interruptions and challenges while attempting my certification, The exam got paused automatically without any violation,i had also contacted kryterion, but they told Databricks could only help on this issue. Eventually my...
- 304 Views
- 4 replies
- 3 kudos
Latest Reply
- 3 kudos
Could you please help me , I faced same issue also raised ticket #01072089
- 3 kudos
- 50 Views
- 0 replies
- 0 kudos
Request for Assistance – Databricks Data Engineer Associate Exam Suspended – Ticket #01071693
Hi @Cert-Team @cert-ops,I need your assistance regarding my Databricks Certified Data Engineer Associate examination, which was unexpectedly suspended.During the exam, while reading and reviewing the questions on the screen my exam was suspended.I im...
- 50 Views
- 0 replies
- 0 kudos
- 16849 Views
- 1 replies
- 2 kudos
- 16849 Views
- 1 replies
- 2 kudos
Latest Reply
- 2 kudos
Nice demo, I have to try it yet.Can we add a DQ to check if look up values in ref table has the IDs or not for early arriving facts. May be it is already there, as I said have to try it out yet.
- 2 kudos
- 86 Views
- 0 replies
- 1 kudos
Announcement | Genie with Genie Ontology delivers 1.6× the accuracy with less than half the tokens
A new enterprise benchmark developed with Turing compares Genie with two frontier agents on business questions in a live Databricks workspace. On this benchmark, Genie achieved a 91% pass rate, compared with 45% and 58%, while using less than half th...
- 86 Views
- 0 replies
- 1 kudos
- 74 Views
- 1 replies
- 3 kudos
Lakebase in production: what surprised you?
Hi all,I'm evaluating Lakebase for my company and writing up a recommendation. Most of what I can find is launch material and overview posts. Useful for understanding what it does, less useful for deciding whether to run it.So I'd rather hear from pe...
- 74 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
For example: When we talk about Lakbase costs, resources mention simply aboutPrice per CU-hour(List price: $0.58 per DBU, so $0.1235 per CU-h) but Always-On leads you $67.6 per CU per monthWhat about Storage costs(Probably, $0.345 per GB-month)PITR h...
- 3 kudos
- 201 Views
- 1 replies
- 1 kudos
Questions about databrick voucher
Hi,I have already received a Databricks exam voucher. Can I still join the current Learning Festival and qualify for another voucher?In addition, how can I check which courses count toward the festival requirements? I completed some of the courses du...
- 201 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @cakkitleung @, good questions. Here's what the event rules (https://community.databricks.com/t5/learning-events/databricks-advanced-learning-festival-november-10-december-08/ev-p/172328) say: Which courses count: you need to finish every module i...
- 1 kudos
- 162 Views
- 2 replies
- 0 kudos
Community article marked as spam incorrectly
Hi team,My article "What It Takes to Read Lakeflow Pipeline Tables from Snowflake: A Unity Catalog Walkthrough" in Community Articles was marked as spam right after I published it. It is an original technical write-up on reading Lakeflow Declarative ...
- 162 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi team, tagging @Advika, @Rishabh_Tiwari, and @Sujitha here as my account/article is still stuck in the spam queue. Could someone please manually clear it? Thank you!" (Even if the dropdown mention box doesn't pop up, the text will still alert human...
- 0 kudos
- 91 Views
- 1 replies
- 0 kudos
Dashboards dual axis
Hi!I am using AI/BI dashboards with dual y-axis. If I have Axis Range set to Default, it is not very good at auto-scaling. See attached example - notice the huge amount of dead spaceI could of course chose custom range to get better result, but then...
- 91 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @hhaaland, Current documentation on the AI/BI dashboards with dual y-axis states that axis range has three options: Default ("Use an automatic range")Per facet, which only applies to faceted chartsCustom ("Set fixed Minimum and Maximum values") Th...
- 0 kudos
- 100 Views
- 2 replies
- 0 kudos
Lakebase Data API
We need to bring the json data from external API and need to load it into lakebase API tables.Please suggest in connecting this.
- 100 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Adding to the notebook approach above, two things to plan for. The Data API wants an OAuth bearer token on every request, and those tokens are short lived (about an hour per the docs), so a scheduled job should fetch a fresh one at the start of each ...
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1515 | |
| 1255 | |
| 1190 | |
| 961 |
Latest from our Blog
Reinforcement Learning on Databricks: Building a Contextual Bandit
Is MLflow really built only for supervised learning, or can it handle something like reinforcement learning? A customer asked me exactly this. They're running a contextual-bandit-style system on-premi...
From AWS Glue Catalog to Databricks Unity Catalog: An End-to-End Migration Guide
Migrating from AWS Glue Catalog to Unity Catalog Migrating from AWS Glue Catalog to Databricks Unity Catalog (UC) doesn’t need to be a risky “big bang” cutover. With Lakehouse Federation and the new U...
An example of AI coworker for people who have never queried data
An example of AI coworker for people who have never queried data Talking to your data doesn't mean your data understands you. AI knows data and query languages, but it must also learn the specific jar...
Controlling Genie budget under the new pay-as-you-go model
In my role as an architect and customer advisor, I often find that governance, security, and cost control come up together. That is understandable. As organisations move from AI experimentation to ent...
