cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 
Community Bricktalk | Master Multi-Cloud Data Sharing with OpenSharing & Global Distribution

Hey Databricks Community! Join us for a free community-sponsored BrickTalk where we’ll explore Multi-Cloud Data Sharing with OpenSharing SecureConnect & Global Distribution. BrickTalks is a community event series where Databricks experts share real-w...

  • 501 Views
  • 1 replies
  • 0 kudos
a week ago
Databricks Advanced Learning Festival: November 10 - December 08 2026

Databricks Advanced Learning Festival November 10 – December 8, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are ...

  • 58021 Views
  • 99 replies
  • 17 kudos
10-08-2026
✈️ 9 Cities, 1 Epic November: The Data + AI World Tour is Here!

NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...

  • 3559 Views
  • 1 replies
  • 1 kudos
3 weeks ago
DATA + AI World Tour 2026

REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...

  • 4938 Views
  • 0 replies
  • 4 kudos
09-01-2026
Databricks Community Champion - October 2026 - Anuj Lathi

Community Champion • October 2026 Meet Anuj Lathi Behind every resolved question in the Databricks Community is someone who chose to share what they know. Our Community Champion Program recognizes those who consistently support others, from beginners...

  • 98 Views
  • 0 replies
  • 2 kudos
10 hours ago
Solution Accelerator Series | Predict Patient Disease Risk & Measure Quality

Predicting patient disease risk and measuring quality of care are important to precision health. This Solution Accelerator demonstrates a machine learning workflow using healthcare data to identify clinical and demographic factors associated with dis...

  • 296 Views
  • 0 replies
  • 1 kudos
a week ago
🌟 Community Pulse: Your Community Roundup! September 14 – October 11, 2026

Recap • September 14 – October 11 Community Pulse Four weeks of articles, learning content, and conversations – the highlights, all in one read. Community Stars   The members who showed up and made a real difference : @ivanvyd @data_pulse @Tho...

  • 1206 Views
  • 0 replies
  • 4 kudos
10-15-2026

Community Activity

turagittech
by > • Contributor II
  • 448 Views
  • 5 replies
  • 2 kudos

guidance on cleainig up after long cdc failure

Hi All,We had a CDC failure which took far to long to resolve. A conversation with vendors on that.Does anyone have any guidance on the process steps to identifying the missed changes and applying them to the tables.I have so far run a query to ident...

  • 448 Views
  • 5 replies
  • 2 kudos
Latest Reply
Jen_Evangelista
New Contributor III
  • 2 kudos

Hi @turagittech and @Louis_Frolio,Louis provided an excellent explanation of the Lakeflow Connect recovery process. I'd like to complement it with a practical reconciliation and validation approach, especially since the SQL Server CDC full refresh co...

  • 2 kudos
4 More Replies
Tushar_Parekar
by • Community Manager
  • 63 Views
  • 0 replies
  • 0 kudos

Announcement | Introducing the Databricks AI Index: The state of enterprise AI tokenomics

With new models launching at a rapid pace, teams need more than leaderboard rankings to decide what to use. The Databricks AI Index brings together real-world enterprise adoption and spending data with ongoing coding-agent evaluations to help make mo...

Token share.png
  • 63 Views
  • 0 replies
  • 0 kudos
ZindeshaAshiq
by > • New Contributor
  • 164 Views
  • 4 replies
  • 0 kudos

Not able to use 'Serverless Starter Warehouse'

Hey, I have recently started using Free Edition and since beginning, I am getting this issue.I have tried to run this warehouse but could not resolve it on my own. What can be done ?

ZindeshaAshiq_0-1794937644818.png
Get Started Discussions
compute
Serverless Starter Warehouse
  • 164 Views
  • 4 replies
  • 0 kudos
Latest Reply
ZindeshaAshiq
New Contributor
  • 0 kudos

 Hello @SumeshKashyap , I have tried both the options you mentioned. I changed the ownership to myself (2nd screenshot). Still, the issue persists. In the first screenshot pasted here, it has no option to delete and create a new serverless warehouse....

  • 0 kudos
3 More Replies
jumelik
by > • Visitor
  • 29 Views
  • 0 replies
  • 0 kudos

Hourly streaming table refresh jobs keep running after the table was dropped (Free Edition)

I’m using Databricks Free Edition. I created the streaming table retail_analytics.sales_data.customers_latest with SCHEDULE EVERY 1 HOUR and later dropped the table. Two refresh jobs with the same name still run hourly and send failure emails.Job 516...

  • 29 Views
  • 0 replies
  • 0 kudos
Isaac_18
by > • Contributor II
  • 27 Views
  • 0 replies
  • 0 kudos

Undo a bad write on a Delta table: history, time travel and RESTORE

Sooner or later someone runs a MERGE with the wrong join key, or an overwrite against the wrong table. On a plain parquet folder that's a restore-from-backup afternoon. On Delta, the old versions are usually still there, and you can get back in a few...

  • 27 Views
  • 0 replies
  • 0 kudos
inaafina
by > • New Contributor
  • 276 Views
  • 5 replies
  • 0 kudos

Overwrite Job Errors

I keep on getting this error message when trying to create a parquet in my notebook. Has anyone found this error too? My overwrite path was working perfectly fine before.SparkConnectGrpcException: (java.lang.IllegalStateException) operationId: d5871d...

  • 276 Views
  • 5 replies
  • 0 kudos
Latest Reply
Isaac_18
Contributor II
  • 0 kudos

Hi @inaafina, adding a bit more context on this one, because the error message is confusing.That message doesn't come from your parquet write itself. It comes from Spark Connect's bookkeeping for each operation. (Serverless notebooks and Databricks C...

  • 0 kudos
4 More Replies
Hardik2
by > • New Contributor
  • 185 Views
  • 1 replies
  • 0 kudos

Query regarding last name while creating account on Webaccessor during booking of certification exam

Hello everyone,I recently received my voucher for the Databricks Data Engineer Associate certification. While creating an account on Webassessor to schedule my exam, I encountered an issue with the Last Name field.My government-issued IDs contain onl...

  • 185 Views
  • 1 replies
  • 0 kudos
Latest Reply
Isaac_18
Contributor II
  • 0 kudos

Hi @Hardik2, this comes up fairly often, so you're not the only one.What people with a single legal name have reported from Kryterion (the company behind Webassessor) is to enter your name in both fields: First Name = your name, Last Name = the same ...

  • 0 kudos
SantiNath_Dey
by > • Contributor II
  • 102 Views
  • 2 replies
  • 0 kudos

Validation of API-Based Promotion of Databricks Genie Agent from Dev to QC

As per the requirement, I will extract the JSON definition of the existing Marketplace Compliance Genie from the non-production Databricks environment and use the Databricks Genie Conversation API to create an equivalent agent with a different name. ...

  • 102 Views
  • 2 replies
  • 0 kudos
Latest Reply
Isaac_18
Contributor II
  • 0 kudos

Hi @SantiNath_Dey, your plan works, with one small correction: the Conversation API is for asking questions. Copying the agent's definition is done with the Genie space endpoints, which are GA.1. Export from Dev. You need at least CAN EDIT on the sou...

  • 0 kudos
1 More Replies
vamsi_simbus
by > • Databricks Partner
  • 138 Views
  • 1 replies
  • 0 kudos

Anyone using Kinaxis Data Publish (Delta Sharing) from Databricks Marketplace?

Hi all,We're looking at Kinaxis Data Publish on the Databricks Marketplace. It shares Kinaxis Maestro planning data into Databricks through Delta Sharing. We requested access a couple of weeks ago and haven't heard back, so I'd like to hear from anyo...

  • 138 Views
  • 1 replies
  • 0 kudos
Latest Reply
Isaac_18
Contributor II
  • 0 kudos

Hi @vamsi_simbus, I haven't used this specific listing, but I can answer the parts that come down to how Marketplace and Delta Sharing work, which should help while you wait.Direction. Delta Sharing is one-way and read-only. The provider (Kinaxis) sh...

  • 0 kudos
BoostMFB
by > • New Contributor
  • 167 Views
  • 4 replies
  • 0 kudos

Claude Opus 5, Opus 4.8 and Fable 5.1 Access Disabled – Databricks on AWS

Hello Databricks Community Team,We're experiencing difficulties accessing Anthropic Claude models through our Databricks workspace on AWS.Both Claude Opus 5 and Opus 4.8 return PERMISSION_DENIED, stating that model access is disabled for our workspac...

  • 167 Views
  • 4 replies
  • 0 kudos
Latest Reply
BoostMFB
New Contributor
  • 0 kudos

Hi @Valeria_Koz_DBX ,Thank you for your guidance.We've successfully tested GPT OSS 120B and will now proceed with the Databricks Sales contact form to request account verification.We'll also ensure that an account administrator is registered using ou...

  • 0 kudos
3 More Replies
Kirankumarbs
by > • Honored Contributor
  • 129 Views
  • 2 replies
  • 1 kudos

Cert rotation killed our continuous jobs. The paused one stayed dead

Hi, This morning our alerts channel filled up with this on every long-running job:Run failed with error message Cluster 1102-191751-zfltzzqf was terminated during the run (cluster state message: Cluster was terminated because it was using old TLS ce...

  • 129 Views
  • 2 replies
  • 1 kudos
Latest Reply
Kirankumarbs
Honored Contributor
  • 1 kudos

Yeap that's the behaviour on Continuos job!Also, the core intention on this post is on the notification Azure Databricks sent just now:On 11-17 Oracle disclosed an OpenJDK vulnerability (CVE-2026-114938). Databricks is fixing it in two steps. First i...

  • 1 kudos
1 More Replies
SrinuB
by > • New Contributor III
  • 43 Views
  • 0 replies
  • 0 kudos

Auto Loader: Schema Evolution and the Rescued Data Column

Ingestion · Auto Loader · What happens the day a source adds a column, and how not to lose dataBy @SrinuB  in collaboration with @sridharplv At 2 a.m. a source system adds a column. Your Auto Loader stream stops with an UnknownFieldException and the ...

blog10_auto_loader.png
  • 43 Views
  • 0 replies
  • 0 kudos
SrinuB
by > • New Contributor III
  • 46 Views
  • 0 replies
  • 0 kudos

The Small Files Problem, and What Predictive Optimization Does About It

Optimization · Delta Lake · Why a table gets slower as it grows, and what to stop doing by handBy @SrinuB  in collaboration with @sridharplv A table that loads every 10 minutes works fine for a month, then dashboards on it start crawling. Nothing in ...

blog9_small_files.png
  • 46 Views
  • 0 replies
  • 0 kudos
Tushar_Parekar
by • Community Manager
  • 80 Views
  • 0 replies
  • 0 kudos

Announcement | Migrate Effortlessly to the Databricks Lakehouse with Genie Migrate (Now GA)

Genie Migrate for Lakehouse is now Generally Available, helping teams accelerate warehouse migrations by converting proprietary SQL into open SQL or PySpark on Databricks. Start in your workspace, track the migration in one project, and review conver...

Genie Migrate.png
  • 80 Views
  • 0 replies
  • 0 kudos
karanvichare
by > • New Contributor
  • 108 Views
  • 1 replies
  • 1 kudos

Auto Loader: addNewColumns can still stop your stream

A useful detail in the Auto Loader docs: addNewColumns does not mean the stream keeps running when a new column arrives.Auto Loader updates its saved schema, then stops with UnknownFieldException. Restarting the stream picks up the new schema. Databr...

  • 108 Views
  • 1 replies
  • 1 kudos
Latest Reply
ThomazNeto
Databricks Partner
  • 1 kudos

Hi @karanvichare,Good call. Just adding something I’ve seen cause confusion in production environmentsWith addNewColumns, Auto Loader will take care of detecting the new column and updating the schema it keeps in cloudFiles.schemaLocation. What it wo...

  • 1 kudos
Welcome to the Databricks Community!

Once you are logged in, you will be ready to post content, ask questions, participate in discussions, earn badges, and more.

Spend a few minutes exploring Get Started Resources, Learning Paths, Certifications, and Platform Discussions.

Join Learning Events here in the Community.

Connect with peers through Databricks User Groups and learn more about Community Events happening near you. We’re excited to see you get involved.

Top Kudoed Authors

Latest from our Blog

Private connectivity from Databricks on AWS to Amazon S3

Table of contents Why secure connectivity mattersKey conceptsUnity Catalog Access to S3 - Authentication and PermissionsClassic compute connecting to your S3 buckets S3 gateway endpointS3 interface en...

192Views 1kudos

Level Up Your Genie Agent with Unstructured Files

Going Beyond Structured Data Genie Agents have always answered questions about your structured data, including tables, views, and metric views. Now they can also analyze files in volumes, such as PDF ...

349Views 0kudos