Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, October 29! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 790 Views
- 1 replies
- 3 kudos
2 weeks ago
Hey Databricks Community! Join us for a free, community-sponsored BrickTalk on Thursday, November 5! BrickTalks is a community event series where Databricks experts share real-world use cases, demos, and practical insights for building with data and ...
- 293 Views
- 0 replies
- 2 kudos
Thursday
NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...
- 300 Views
- 1 replies
- 0 kudos
Monday
DATA + AI LIVE Time: AMER Nov 11 / 9 AM PT / 12 PM ET APAC Nov 12 / 9:30 AM IST / 12 PM SGT / 1 PM JST-KST / 3 PM AEDT EMEA Nov 17 / 9 AM GMT / 10 AM CET Register for the Workshop Note: Marking RSVP on this Community event does not register you fo...
- 718 Views
- 0 replies
- 2 kudos
a week ago
REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...
- 3188 Views
- 0 replies
- 4 kudos
09-01-2026
Free · Hands-on · Instructor-led AI/BI + Genie Launchpad From dashboards your team can trust to answers in plain language with Genie. A three-day arc of live, hands-on sessions, each built for a different role. Join only the day or days that fit you...
- 219 Views
- 0 replies
- 1 kudos
Friday
Responsible gaming initiatives are becoming increasingly important as regulation, gameplay experiences and the betting and gaming industry continue to expand. The Responsible Gaming Solution Accelerator, developed in partnership with AWS, shows how t...
- 249 Views
- 1 replies
- 4 kudos
Thursday
Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...
- 571 Views
- 0 replies
- 4 kudos
2 weeks ago
Community Activity
- 496 Views
- 14 replies
- 3 kudos
MS Fabric Direct Lake, works with delta tables only?
Lately we started using Direct Lake to use the results of our ingestion pipelines (gold tables) in PBI dashboards. This is working ok but has one annoying and troublesome issue. Which is: the gold tables are the end result of declarative pipelines so...
- 496 Views
- 14 replies
- 3 kudos
Latest Reply
- 3 kudos
As a follow up to this: I implemented the MERGE INTO scheme on the one large table we have (50M rows). It does indeed write changes to only a small number of rows per job run, typically a few thousand. BUT the MERGE INTO code is much slower than REPL...
- 3 kudos
- 102 Views
- 3 replies
- 0 kudos
Unable to Access Databricks Workspace After Changing Display Name
Dear Databricks Support Team,I am writing to request your assistance with an issue affecting my personal Databricks account.I have been using Databricks for the past three months with my personal account, karagaonkarm@gmail.com, to learn Databricks a...
- 102 Views
- 3 replies
- 0 kudos
- 67 Views
- 1 replies
- 0 kudos
Possible Incorrect Answer Key: Spark ML Estimators — OneHotEncoder, Imputer, and StandardScaler
Hello Databricks Community,While preparing for the Databricks Machine Learning Associate certification, I came across a question in a practice assessment that I believe may have an incorrect or incomplete answer key.Question:"In a Spark ML Pipeline, ...
- 67 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @amittian, Thanks for flagging this, you're right. Since Spark 3.0, OneHotEncoder is an Estimator. It learns the category sizes during fit() and returns a OneHotEncoderModel, so three of the four options are Estimators. The likely cause is that th...
- 0 kudos
- 233 Views
- 1 replies
- 0 kudos
Como funciona la facturación y pago en Databricks?
Hola comunidad,Tengo una duda sobre cómo funciona la facturación en cuentas Pay-As-You-Go y quería saber si a alguien más le ha pasado algo similar.En mi panel de "Usage" veo un consumo acumulado de varios cientos de dólares durante el último año (pr...
- 233 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
¡Hola! Gracias por la pregunta y por los detalles, ayudan mucho. Cargos mensuales: cuando el método de pago es una tarjeta de crédito, Databricks cobra el uso mensualmente en esa tarjeta. Si nunca has visto ningún cargo, vale la pena confirmarlo con ...
- 0 kudos
- 40 Views
- 1 replies
- 0 kudos
How to enable DeepSeek V4.1 Flash (1017) on a new AWS workspace?
Databricks Support referred me to the Community for help with account verification and model access.I have a newly created Databricks on AWS workspace. The account console shows Premium with AWS Marketplace billing configured. I authenticate using th...
- 40 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @sillytail_dev, Thanks for the detail. It makes this easier to pin down.To my knowledge, this shouldn't be a Unity Catalog permissions problem. You've already got EXECUTE on system.ai, and you're using the right model name for the Unity Gateway r...
- 0 kudos
- 441 Views
- 1 replies
- 0 kudos
Login Issue
I had community account with databricks and I was getting error with login. So I decided to get them closed and asked the team to close it. Mail subject [] Re: Account deletion: Re: Data Deletion Request / SSO Authentication Loop - [ ref:_00D61JGc...
- 441 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi there, Have a look at this and see if any of these will help resolve your issuehttps://community.databricks.com/t5/support-faqs/databricks-community-sso-august-3rd-2024/ta-p/78459
- 0 kudos
- 321 Views
- 1 replies
- 0 kudos
Is your AI strategy driving real impact or just more pilots?
AI only matters when it improves workflows, speeds up decisions, and creates measurable business value.So, what would real AI impact look like inside your company?
- 321 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
You mentioned that AI only matters when it creates measurable business value. The biggest trap I see companies fall into is trying to measure that value after the implementation is already done. If you don't pick the metrics you want to move before y...
- 0 kudos
- 20 Views
- 0 replies
- 0 kudos
Genie One PDF Download Cut Off
Hello,Today when we downloaded the pdf file from Genie One and the results are off center to the left. We've tried different browsers but the results are cutoff and shifted to the left. Is anyone else experiencing this or know of a solution to correc...
- 20 Views
- 0 replies
- 0 kudos
- 138 Views
- 2 replies
- 0 kudos
Missing Voucher - Learning Festival - Ticket #01051773
Hi @Jim_AndersonThe support team closed my ticket (#01051773) and asked me to reach out to you directly here.I completed 100% of my Data Engineer Learning Plan on October 13th, but I did not receive my 50% festival voucher.Here are my details:- Code:...
- 138 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi , I've sent a dm to @Jim_Anderson but still no response from him on the matter .I've checked my email and nothing is there. Thank you !
- 0 kudos
- 1094 Views
- 5 replies
- 5 kudos
Visual, step-by-step curriculum for mastering DABs and Infrastructure as Code
Most public GitHub repositories for Databricks are just dry code dumps. You get a massive YAML file, a basic README, and are expected to just figure it out.When building production-grade infrastructure, engineers need to see the architecture and unde...
- 1094 Views
- 5 replies
- 5 kudos
Latest Reply
- 5 kudos
This appears to be a truly useful resource for understanding 'Databricks Asset Bundles' and real-world 'IaC' workflows. I recently passed my exam; in my experience, when preparing for 'Databricks' certifications, combining hands-on practice with a hi...
- 5 kudos
- 289 Views
- 13 replies
- 4 kudos
Salesforce - "Unexpected error occurred" while connecting with Databricks
Hi everyone,I am using Salesforce trail version. I am getting error which shows "Unexpected error occurred" while connecting it with Databricks free edition, However, I already passed the necessary OAuth with the credentials.Please advise what action...
- 289 Views
- 13 replies
- 4 kudos
Latest Reply
- 4 kudos
@J-Data Yeah, @Aamir2028 has opened the thread and he could do that.Hopefully he has found the issue as well and able to resolve salesforce connector.
- 4 kudos
- 41655 Views
- 24 replies
- 51 kudos
Databricks Announces the Industry’s First Generative AI Engineer Learning Pathway and Certification
Today, we are announcing the industry's first Generative AI Engineer learning pathway and certification to help ensure that data and AI practitioners have the resources to be successful with generative AI. At Databricks, we recognize that generative ...
- 41655 Views
- 24 replies
- 51 kudos
Latest Reply
- 51 kudos
Great initiative by Databricks! This is a valuable opportunity to build practical GenAI skills and stay ahead in the rapidly evolving AI space.
- 51 kudos
- 109 Views
- 4 replies
- 2 kudos
Best practices for processing HVR CDC data in Databricks when handling out-of-order updates, delete
Hi Databricks Community,I am working on a data lakehouse architecture on AWS, where HVR captures changes from OLTP databases such as Oracle and PostgreSQL, AWS S3 is used for storage, and Databricks handles data processing across Bronze, Silver, and ...
- 109 Views
- 4 replies
- 2 kudos
Latest Reply
- 2 kudos
Great discussion! I’d lean toward AUTO CDC for handling out-of-order events and deletes, with proper sequencing and deduplication to keep the Delta tables consistent. Performance tuning and audit history are also key for a reliable production setup.
- 2 kudos
- 294 Views
- 4 replies
- 7 kudos
Resolved! Beyond Bronze, Silver, and Gold: When Does a Separate Stage Make Sense?
I recently published my first technical blog! I was a little nervous about sharing it, but I’m happy to take this first step. I hope to keep sharing what I learn and improve my writing along the way.For this article, I chose a question I’ve encounter...
- 294 Views
- 4 replies
- 7 kudos
Latest Reply
- 7 kudos
Thanks for sharing this article! I particularly like the point that separating transformation logic, persisting intermediate results, and exposing datasets to consumers are three different architectural decisions.In our environment, we use Databricks...
- 7 kudos
- 57 Views
- 0 replies
- 0 kudos
Is a NAT Gateway required for a VNet-injected authentication workspace ?
Hello Community,We are deploying Azure Databricks in France Central with VNet injection, Secure Cluster Connectivity (SCC) and Private Link.We have a dedicated workspace for the browser_authentication private endpoint, as recommended in the Databrick...
- 57 Views
- 0 replies
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2293 | |
| 1505 | |
| 1255 | |
| 1189 | |
| 961 |
Latest from our Blog
[PARTNER BLOG] Scaling Auto Loader on AWS: Moving to File Notification Mode with Managed File Events
Contents IntroductionUnderstanding the Key ConceptsWhy File Notification with Managed File Events?Key Benefits of Managed File EventsArchitecture OverviewPrerequisitesPhase 1: AWS IAM SetupPhase 2: Da...
End-to-End Cyber Lakehouse Streaming via Zerobus Ingest, Spark Declarative Pipelines, and OCSF
Streaming raw events into a cyber lakehouse and normalizing them to a standard schema is a common pattern for security analytics. This blog walks through an end-to-end architecture that uses Databrick...
AI Functions for Synthetic Test Data: Generate Realistic Datasets in Pure SQL
The views expressed in this post are my own and do not represent those of my employer. Not long ago, generating realistic synthetic data meant building custom pipelines with GANs, Transformers, or RN...
Databricks maintenance and cleanup: Visualize, Clean, and Log with Declarative Automation Bundles
Introduction Managing Databricks environments can quickly become overwhelming as jobs, AI Search indexes, and pipeline artifacts accumulate, making manual cleanup, logging, and compliance difficult. T...
