NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...
- 2280 Views
- 1 replies
- 1 kudos
2 weeks ago
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 1694 Views
- 0 replies
- 2 kudos
3 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 4178 Views
- 0 replies
- 4 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 1181 Views
- 0 replies
- 1 kudos
2 weeks ago
Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...
- 740 Views
- 1 replies
- 5 kudos
3 weeks ago
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 921 Views
- 0 replies
- 4 kudos
4 weeks ago
Community Activity
- 59 Views
- 2 replies
- 0 kudos
Databricks Unity Catalog JDBC Connection: Can properties reference Databricks Secrets
I'm creating a JDBC connection in Databricks Unity Catalog to connect to Trino.The connection requires SSL configuration, including a client keystore and truststore.When creating the connection through the Databricks UI, I enter these as key-value pa...
- 59 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
The working pattern in our jobs while syncing views from Postgres! We didn't put credentials in a UC connection at all. Probably, can you explain more why are creating connection directly at UC level?ad question 1:as per this documentation, it says t...
- 0 kudos
- 8 Views
- 0 replies
- 0 kudos
material
How do I access to all the material after November 19 2026
- 8 Views
- 0 replies
- 0 kudos
- 76 Views
- 3 replies
- 0 kudos
Lakeflow Connect (Oracle): backfill a single new column without a full refresh of the table
Hi everyone,We ingest Oracle tables into a Bronze layer with Lakeflow Connect, and our Silver layer is a Lakeflow Spark Declarative Pipeline made of materialized views that read the Bronze tables and apply types and comments from our data dictionary....
- 76 Views
- 3 replies
- 0 kudos
Latest Reply
- 0 kudos
Oracle stores the default of a NOT NULL DEFAULT column added this way as metadata. Existing rows aren't physically rewritten, so there's no redo for LogMiner (CDC) and no cursor change for the query-based connector. Either way, the connector correctl...
- 0 kudos
- 23 Views
- 0 replies
- 0 kudos
One Bundle, Three Environments: CICD for Databricks with Declarative Automation Bundles
DevOps · CICD · Deploy the same definition to dev, staging and prod, and never edit a job in the UI againBy @SrinuB in collaboration with @sridharplv Somebody "just fixed" a production job in the UI on Friday evening. By Monday it no longer matches ...
- 23 Views
- 0 replies
- 0 kudos
- 264 Views
- 4 replies
- 9 kudos
Recording | Bricktalk: Zerobus Ingest & CDC Workflows
Explore Zerobus CDC with @Vicky_Bukta_DB , @OmkarMehta , @WagnerSantos and @Giselle_Go_DB
- 264 Views
- 4 replies
- 9 kudos
Latest Reply
- 9 kudos
Hey @ThomazNeto, PR #349 has already been merged. I'm waiting for the doc (#8411), but the main branch already has the improvement. You can follow this issue https://github.com/debezium/dbz/issues/3026. Probably, it will be closed today!
- 9 kudos
- 109 Views
- 1 replies
- 0 kudos
Do Genie agents use Unity Catalog wikis as context?
Hi all,I tried the new Unity Catalog wikis (Beta) in my own Azure Databricks sandbox, with the public TPC-H sample data. The banner in Catalog Explorer calls the wiki rich documentation "for your team and agents", so I wanted to see if a Genie agent ...
- 109 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
@suranga, thanks for the detailed test. What you're seeing matches the current documentation, so I don't think you missed a setting. Is this expected in the Beta? Yes. Unity Catalog wikis are in Beta, and the docs don't say that Genie Agents use wik...
- 0 kudos
- 37 Views
- 0 replies
- 0 kudos
Unable to Reschedule Databricks Generative AI Associate Exam
I have scheduled my Databricks Generative AI Associate exam for 14th Nov. However, as I am not fully prepared, I would like to postpone the exam to December.Unfortunately, when I try to reschedule, the available options only allow me to prepone the e...
- 37 Views
- 0 replies
- 0 kudos
- 40 Views
- 0 replies
- 0 kudos
Memory Profiling
How do you debug OOM on long-running streaming jobs?Hi All,One of my Structured Streaming jobs has started dying with OutOfMemoryError. Runs fine for about approx 40 hours, then falls over, restarts, and does the same thing again. I had introduced fe...
- 40 Views
- 0 replies
- 0 kudos
- 4088 Views
- 1 replies
- 1 kudos
Resolved! How to actually get job_id and run_id in a Databricks Python wheel task (Avoid Hallucinations)
We needed job_id and run_id in a custom metrics Delta table so we could join to `system.lakeflow.job_run_timeline`. Tried four approaches before finding the one that works on serverless compute.What doesn't workspark.conf.get("spark.databricks.job.id...
- 4088 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
If some one just looking for solution, here you goJob-level parameters with dynamic value references, piped into task named_parameters:parameters: - name: job_id default: "{{job.id}}" - name: run_id default: "{{job.run_id}}" tasks: - python_wheel_ta...
- 1 kudos
- 110 Views
- 1 replies
- 0 kudos
ASF Corporation
Hello Databricks Community,I'm representing ASF CORPORATION, a piling, foundation engineering and construction company established in 2017 and based in Dhaka, Bangladesh.Our company specializes in hydraulic rotary piling, rotary drilling, auger borin...
- 110 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @asfcorporation see if you can gain some inspiration from here :1) https://www.databricks.com/solutions/accelerators?industry=Manufacturing2)https://www.databricks.com/resources/demos/tutorials/lakehouse-platform/iot-and-predictive-maintenance3) h...
- 0 kudos
- 77 Views
- 2 replies
- 0 kudos
Delta Tables: Is there any possibility on Delta tables Data file formats other than Parquet
Hi Team,Since Parquet files are immutable and Delta tables framework writes data changes into new data files, Is there any option to specify any other file format and try to use same data file for minor data changes.(Below 10 Record transaction chang...
- 77 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @krishgarikipati Could you clarify what specific issue you are facing with the current Parquet-based Delta implementation that makes you want to explore a different file format? Is the concern primarily the amount of data being rewritten for a ver...
- 0 kudos
- 198 Views
- 4 replies
- 2 kudos
Databricks Exclusive Access
I’m exploring how to set up exclusive access for separate use cases implementation within a shared Databricks workspace, using Microsoft Entra groups and Unity Catalog. I’d love to hear from anyone who has implemented something similar, or is current...
- 198 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
You can start by granting privileges strictly to synced Entra groups and use automatic identity management to structure Unity Catalog privileges for use case isolation while keeping central oversight intact. Dont use legacy SCIM connector as automati...
- 2 kudos
- 270 Views
- 3 replies
- 2 kudos
guidance on cleainig up after long cdc failure
Hi All,We had a CDC failure which took far to long to resolve. A conversation with vendors on that.Does anyone have any guidance on the process steps to identifying the missed changes and applying them to the tables.I have so far run a query to ident...
- 270 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
Checked the full refresh.I can easily control pauses as we only update end user tables one a dayIt is SQL Server CDC. Full refresh completed Ok
- 2 kudos
- 217 Views
- 3 replies
- 1 kudos
AI/BI Dashboard metric views: cross-filter returns no rows when value contains CRLF
SummaryIn an AI/BI Dashboard with a semantic model, selecting a row in a table widget cross-filters a related table through the relationship. This works for normal values. When the selected row has a text value containing a carriage return followed b...
- 217 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @Akash_Murade,Thanks for the clean repro, it makes this really easy to follow. It looks like a bug in how the selected value gets turned into the filter literal, so I'd raise it with Databricks support as well so it gets tracked properly.Until it'...
- 1 kudos
- 204 Views
- 3 replies
- 1 kudos
Resolved! Unity Catalog secrets: GRANT READ SECRET ON SCHEMA fails with PRIVILEGE_NOT_APPLICABLE_TO_ENTITY
Hi,I've been testing Unity Catalog secrets in my own sandbox workspace (Azure Databricks, serverless, environment version 6). READ SECRET can't be granted on a schema there, even though the docs say it can.What I ranGRANT READ SECRET ON SCHEMA secret...
- 204 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Hello @suranga, I took a look at both internal and external documentation and here is what I found. Thanks for the clear writeup, especially the privilege-by-privilege ladder. Thanks also to @Yougasundar for jumping in, though that reply looks like i...
- 1 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1507 | |
| 1255 | |
| 1190 | |
| 961 |
Latest from our Blog
An example of AI coworker for people who have never queried data
An example of AI coworker for people who have never queried data Talking to your data doesn't mean your data understands you. AI knows data and query languages, but it must also learn the specific jar...
Controlling Genie budget under the new pay-as-you-go model
In my role as an architect and customer advisor, I often find that governance, security, and cost control come up together. That is understandable. As organisations move from AI experimentation to ent...
Gold Isn't Enough: Building the Context Layer for Conversational AI
Bronze, Silver, and Gold made data trustworthy. Conversational AI needs a 4th layer: governed meaning. Here's how to build it on Databricks. Two right answers, one wrong decision A VP of Customer Care...
How to stream PostgreSQL CDC into Databricks with Debezium
Data stored in operational databases powers critical business decisions, but making it available in the lakehouse presents significant architecture challenges. Strict enterprise environments could ha...
