Hey Databricks Community! Join us for a free community-sponsored BrickTalk where we’ll explore Multi-Cloud Data Sharing with OpenSharing SecureConnect & Global Distribution. BrickTalks is a community event series where Databricks experts share real-w...
- 73 Views
- 0 replies
- 0 kudos
3 hours ago
NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...
- 2783 Views
- 1 replies
- 1 kudos
2 weeks ago
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 2000 Views
- 0 replies
- 2 kudos
3 weeks ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 4423 Views
- 0 replies
- 4 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 1293 Views
- 0 replies
- 1 kudos
3 weeks ago
Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...
- 785 Views
- 1 replies
- 5 kudos
3 weeks ago
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 972 Views
- 0 replies
- 4 kudos
4 weeks ago
Community Activity
- 104 Views
- 5 replies
- 2 kudos
Missing spark structured streaming metadata blobs?
I'm exploring spark structured streaming, and contemplating uses for it.I'd like to launch a job on a recurring basis from an external scheduler. It will launch a spark job with trigger (availableNow=True). I'm concerned about overlapping executions...
- 104 Views
- 5 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @DB1To3 Just make this concurrent run to 1 for your streaming jobs are your problem is sorted , it wont corrupt checkpoint locatiion
- 2 kudos
- 133 Views
- 3 replies
- 2 kudos
Zerobus to lakebase
Hi,Is there a plan to make lakebase as destination of Zerobus?Thanks.
- 133 Views
- 3 replies
- 2 kudos
Latest Reply
- 2 kudos
Thanks for the link. IMHO, it is the opposite. Previously when there is no option, we have to load data from Kafka to delta table. Now with Lakebase and LTAP, we can consider to use Lakebase as a fast landing zone. Instead of loading data to Lakehous...
- 2 kudos
- 19 Views
- 0 replies
- 0 kudos
Solution Accelerator Series | Predict Patient Disease Risk & Measure Quality
Predicting patient disease risk and measuring quality of care are important to precision health. This Solution Accelerator demonstrates a machine learning workflow using healthcare data to identify clinical and demographic factors associated with dis...
- 19 Views
- 0 replies
- 0 kudos
- 56 Views
- 0 replies
- 0 kudos
From AWS Glue Catalog to Databricks Unity Catalog: An End-to-End Migration Guide
Migrating from AWS Glue Catalog to Unity Catalog Migrating from AWS Glue Catalog to Databricks Unity Catalog (UC) doesn’t need to be a risky “big bang” cutover. With Lakehouse Federation and the new Upgrade Foreign Table workflow, you can incremental...
- 56 Views
- 0 replies
- 0 kudos
- 292 Views
- 4 replies
- 1 kudos
Resolved! Unity Catalog secrets: GRANT READ SECRET ON SCHEMA fails with PRIVILEGE_NOT_APPLICABLE_TO_ENTITY
Hi,I've been testing Unity Catalog secrets in my own sandbox workspace (Azure Databricks, serverless, environment version 6). READ SECRET can't be granted on a schema there, even though the docs say it can.What I ranGRANT READ SECRET ON SCHEMA secret...
- 292 Views
- 4 replies
- 1 kudos
Latest Reply
- 1 kudos
Hello @suranga, I took a look at both internal and external documentation and here is what I found. Thanks for the clear writeup, especially the privilege-by-privilege ladder. Thanks also to @Yougasundar for jumping in, though that reply looks like i...
- 1 kudos
- 22 Views
- 0 replies
- 0 kudos
Dashboards dual axis
Hi!I am using AI/BI dashboards with dual y-axis. If I have Axis Range set to Default, it is not very good at auto-scaling. See attached example - notice the huge amount of dead spaceI could of course chose custom range to get better result, but then...
- 22 Views
- 0 replies
- 0 kudos
- 210 Views
- 5 replies
- 5 kudos
Resolved! Databricks Unity Catalog JDBC Connection: Can properties reference Databricks Secrets
I'm creating a JDBC connection in Databricks Unity Catalog to connect to Trino.The connection requires SSL configuration, including a client keystore and truststore.When creating the connection through the Databricks UI, I enter these as key-value pa...
- 210 Views
- 5 replies
- 5 kudos
Latest Reply
- 5 kudos
Hi @billpchie,On your first question: the CREATE CONNECTION reference says that for any option that carries a credential, you should use the secret function instead of a literal value. So create the connection in SQL instead of the UI, for example wi...
- 5 kudos
- 229 Views
- 2 replies
- 1 kudos
Private network gateway (ALL_TRAFFIC): serverless can't reach on-prem by raw IPv4, only by hostname
Hi all,We're testing the private network gateway (Beta) on Azure Databricks so that serverless compute egresses through a subnet in our VNet and reaches on-prem resources (through a hub firewall + ExpressRoute/VPN) from a predictable IP range.Setup- ...
- 229 Views
- 2 replies
- 1 kudos
Latest Reply
- 1 kudos
Hi @Ignacio_Soler,Your test write-up is very clear, and I read the docs the same way you do. The Azure page describes destinations only as DNS names. Its routing table ends with "Default Azure Databricks serverless egress: All other outbound traffic"...
- 1 kudos
- 85 Views
- 2 replies
- 2 kudos
How Can We Improve Data Pipeline Performance in Databricks?
Hello Databricks Community!I'm exploring different ways to improve data pipeline performance and make data processing more efficient using Databricks.As datasets continue to grow, maintaining fast, reliable, and cost-effective data pipelines becomes ...
- 85 Views
- 2 replies
- 2 kudos
Latest Reply
- 2 kudos
Hi @JazmineSims,Good questions. Here is what I use, in your order. 1) For large Spark jobs, open the query profile or the Spark UI first and find the stage with the most time, spill or skew, before you change compute. Also filter early, so that data ...
- 2 kudos
- 73 Views
- 0 replies
- 0 kudos
Community Bricktalk | Master Multi-Cloud Data Sharing with OpenSharing & Global Distribution
Hey Databricks Community! Join us for a free community-sponsored BrickTalk where we’ll explore Multi-Cloud Data Sharing with OpenSharing SecureConnect & Global Distribution. BrickTalks is a community event series where Databricks experts share real-w...
- 73 Views
- 0 replies
- 0 kudos
- 46 Views
- 0 replies
- 0 kudos
Questions about databrick voucher
Hi,I have already received a Databricks exam voucher. Can I still join the current Learning Festival and qualify for another voucher?In addition, how can I check which courses count toward the festival requirements? I completed some of the courses du...
- 46 Views
- 0 replies
- 0 kudos
- 33 Views
- 0 replies
- 0 kudos
Your Thoughts on the Modern MI/BI/Engineer Role Description?
Hi all,First post for me….……….we are building the dream that is value enablement through Databricks and are around 6 months in to our journey. I am going to hire in someone to compliment and build upon the team who are already driving us through the ...
- 33 Views
- 0 replies
- 0 kudos
- 43 Views
- 0 replies
- 0 kudos
Question about Databricks Solutions Architect Champion eligibility
Hi everyone,I'm interested in applying for the Databricks Solutions Architect Champion program and would like to clarify a few things about the eligibility and selection process.I have around 4 years of experience in data engineering and have complet...
- 43 Views
- 0 replies
- 0 kudos
- 70 Views
- 1 replies
- 1 kudos
Hi Team Any update about Databricks Festival 10 Nov to 14 Dec?
How do we redeem the exam discounts?Any steps, any guide
- 70 Views
- 1 replies
- 1 kudos
Latest Reply
- 1 kudos
https://community.databricks.com/t5/learning-events/databricks-advanced-learning-festival-november-10-december-08/ec-p/172328/thread-id/10615
- 1 kudos
- 70 Views
- 0 replies
- 0 kudos
Making AI-agent writes safe on Databricks: lineage, shallow clones, null-safe diffs, rollback
A pipeline change can run successfully and still ship wrong data: a join that duplicates rows, a filter that moves a revenue total by a few percent. With AI agents now writing more pipeline code, I wanted a check that runs before a change reaches pro...
- 70 Views
- 0 replies
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1511 | |
| 1255 | |
| 1190 | |
| 961 |
Latest from our Blog
From AWS Glue Catalog to Databricks Unity Catalog: An End-to-End Migration Guide
Migrating from AWS Glue Catalog to Unity Catalog Migrating from AWS Glue Catalog to Databricks Unity Catalog (UC) doesn’t need to be a risky “big bang” cutover. With Lakehouse Federation and the new U...
An example of AI coworker for people who have never queried data
An example of AI coworker for people who have never queried data Talking to your data doesn't mean your data understands you. AI knows data and query languages, but it must also learn the specific jar...
Controlling Genie budget under the new pay-as-you-go model
In my role as an architect and customer advisor, I often find that governance, security, and cost control come up together. That is understandable. As organisations move from AI experimentation to ent...
Gold Isn't Enough: Building the Context Layer for Conversational AI
Bronze, Silver, and Gold made data trustworthy. Conversational AI needs a 4th layer: governed meaning. Here's how to build it on Databricks. Two right answers, one wrong decision A VP of Customer Care...
