cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 
Databricks Advanced Learning Festival: November 10 - December 08 2026

Databricks Advanced Learning Festival November 10 – December 8, 2026 Join us for a four-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whether you are ...

  • 65474 Views
  • 116 replies
  • 20 kudos
10-08-2026
✈️ 9 Cities, 1 Epic November: The Data + AI World Tour is Here!

NOVEMBER · THE TOUR IS ON THE MOVE Nine stops. Three regions.One epic November. THIS MONTH'S ROUTE Munich → Atlanta → Amsterdam → London → Toronto → Los Angeles (Anaheim) → New York City → Milan → Tokyo A free, one-day event on how organizations...

  • 3722 Views
  • 1 replies
  • 1 kudos
4 weeks ago
DATA + AI World Tour 2026

REGISTRATION IS NOW OPEN The Data + AI World Tour is heading your way A free, one-day event on how organizations are building AI they can trust to deliver real outcomes - by grounding models in their own enterprise data and business context. THE...

  • 5074 Views
  • 0 replies
  • 4 kudos
09-01-2026
Databricks Community Champion - October 2026 - Anuj Lathi

Community Champion • October 2026 Meet Anuj Lathi Behind every resolved question in the Databricks Community is someone who chose to share what they know. Our Community Champion Program recognizes those who consistently support others, from beginners...

  • 257 Views
  • 3 replies
  • 4 kudos
Wednesday
Solution Accelerator Series | Predict Patient Disease Risk & Measure Quality

Predicting patient disease risk and measuring quality of care are important to precision health. This Solution Accelerator demonstrates a machine learning workflow using healthcare data to identify clinical and demographic factors associated with dis...

  • 368 Views
  • 0 replies
  • 1 kudos
a week ago
🌟 Community Pulse: Your Community Roundup! October 12 – November 15, 2026

Monthly Recap • October 12 – November 15 Community Pulse Here are the highlights, sorted so you can jump to what you care about. This Month's Community Stars   The members who showed up and made a difference this month: @data_pulse @SumeshKash...

  • 231 Views
  • 1 replies
  • 4 kudos
yesterday

Community Activity

Tushar_Parekar
by • Community Manager
  • 612 Views
  • 5 replies
  • 12 kudos

Recording | Bricktalk: Zerobus Ingest & CDC Workflows

Explore Zerobus CDC with @Vicky_Bukta_DB , @OmkarMehta , @WagnerSantos and @Giselle_Go_DB 

Bricktalk_final.png
  • 612 Views
  • 5 replies
  • 12 kudos
Latest Reply
ThomazNeto
Databricks Partner
  • 12 kudos

Thanks, @WagnerSantos I tested the fix on Debezium Server 3.8.0.Alpha2, built from the tag, with a 10-million-row Postgres snapshot into Zerobus Ingest on an Azure Databricks workspace. It worked as described: the WARN shows up at the threshold and r...

  • 12 kudos
4 More Replies
Kirankumarbs
by > • Honored Contributor
  • 489 Views
  • 5 replies
  • 8 kudos

Memory Profiling

How do you debug OOM on long-running streaming jobs?Hi All,One of my Structured Streaming jobs has started dying with OutOfMemoryError. Runs fine for about approx 40 hours, then falls over, restarts, and does the same thing again. I had introduced fe...

  • 489 Views
  • 5 replies
  • 8 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 8 kudos

Short version: your own charts say this isn't a Java heap leak. The live heap after full GC has no rising floor, and the state store is tiny. What they do show is a container that sits at about 9.5-10 GB of a roughly 10.8 GB limit from the first min...

  • 8 kudos
4 More Replies
ifra_inam
by > • New Contributor II
  • 500 Views
  • 4 replies
  • 2 kudos

Databricks Free Edition: AWS S3 Unity Catalog Storage Credential Fails AssumeRole Validation

I'm using Databricks Free Edition and trying to configure an AWS S3 external location through Unity Catalog.My storage credential validation consistently fails at Assume Role, while Self Assume Role and External ID Condition are skipped.Error: Failed...

  • 500 Views
  • 4 replies
  • 2 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 2 kudos

The error means Databricks' cross-account sts:AssumeRole call is being denied by AWS before any of the later checks run, which is why Self Assume and External ID show as skipped. Everything you've verified is about the IAM role's configuration, so t...

  • 2 kudos
3 More Replies
MikeGo
by > • Valued Contributor
  • 394 Views
  • 5 replies
  • 2 kudos

Zerobus to lakebase

Hi,Is there a plan to make lakebase as destination of Zerobus?Thanks.

  • 394 Views
  • 5 replies
  • 2 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 2 kudos

I can't speak to roadmap commitments in a public forum, and as far as I know Lakebase isn't a direct Zerobus Ingest target today. Your account team can tell you whether it's planned and under what NDA terms. What works today Zerobus Ingest is design...

  • 2 kudos
4 More Replies
Ignacio_Soler
by > • New Contributor
  • 369 Views
  • 3 replies
  • 2 kudos

Private network gateway (ALL_TRAFFIC): serverless can't reach on-prem by raw IPv4, only by hostname

Hi all,We're testing the private network gateway (Beta) on Azure Databricks so that serverless compute egresses through a subnet in our VNet and reaches on-prem resources (through a hub firewall + ExpressRoute/VPN) from a predictable IP range.Setup- ...

  • 369 Views
  • 3 replies
  • 2 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 2 kudos

Short version: your reading matches how I'd expect this to behave. The gateway path is driven by name resolution, so IP literals fall outside it. Treat that as a Beta limitation to confirm with your Databricks account team, not as a guarantee you ca...

  • 2 kudos
2 More Replies
shiv5
by > • New Contributor
  • 331 Views
  • 2 replies
  • 0 kudos

Databricks Free Edition – AI Playground Empty and system.ai Schema Does Not Exist

Hello Databricks Team,I recently created a new Databricks Free Edition account using my Google account and also completed LinkedIn identity verification.I am learning Generative AI and prompt engineering, but I cannot access any foundation models in ...

shiv5_0-1793722606481.png shiv5_1-1793722619692.png shiv5_2-1793722627462.png
  • 331 Views
  • 2 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

Short version: system.ai and the old per-endpoint pages aren't where you get chat models in a current workspace. Pay-per-token models are surfaced through AI Gateway → Models, and that's what Playground reads from. Your errors come from opening lega...

  • 0 kudos
1 More Replies
suranga
by > • Databricks Partner
  • 38 Views
  • 0 replies
  • 0 kudos

Your dashboard knows who opened it. Not what they looked at.

I tested what AI/BI dashboards, Genie One, Genie App Builder and Power BI record when people use a dashboard. Then I built the part that was missing.Most dashboard projects end the same way. We ship it, someone says thanks, and then we guess.Which of...

01_cover.png 02_aibi_dashboard.png 03_query_history.png 04_audit_log.png
  • 38 Views
  • 0 replies
  • 0 kudos
vamsi_simbus
by > • Databricks Partner
  • 195 Views
  • 2 replies
  • 0 kudos

Anyone using Kinaxis Data Publish (Delta Sharing) from Databricks Marketplace?

Hi all,We're looking at Kinaxis Data Publish on the Databricks Marketplace. It shares Kinaxis Maestro planning data into Databricks through Delta Sharing. We requested access a couple of weeks ago and haven't heard back, so I'd like to hear from anyo...

  • 195 Views
  • 2 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

Short version: Kinaxis decides what goes into the share and who gets approved, and from the Databricks side the share is read-only. I can't give you first-hand Kinaxis-specific details, but the platform mechanics answer most of your questions. Data ...

  • 0 kudos
1 More Replies
Pravallika3
by > • New Contributor
  • 104 Views
  • 2 replies
  • 0 kudos

Databricks Apps deployment failing with invalid_client during source code download

Hello Databricks Community,I am using Databricks Free Edition and have developed an Academy of Data Marketing Analytics application using React, Node.js, Express and Databricks SQL.My application was deploying successfully earlier. However, since Nov...

  • 104 Views
  • 2 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

Short version: this is failing on the platform side, before your code ever runs, and the OAuth secret you generated isn't the credential the deployer uses. The most likely cause is a broken binding between the app and its service principal. The fast...

  • 0 kudos
1 More Replies
Kirankumarbs
by > • Honored Contributor
  • 215 Views
  • 2 replies
  • 3 kudos

Lakebase in production: what surprised you?

Hi all,I'm evaluating Lakebase for my company and writing up a recommendation. Most of what I can find is launch material and overview posts. Useful for understanding what it does, less useful for deciding whether to run it.So I'd rather hear from pe...

  • 215 Views
  • 2 replies
  • 3 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 3 kudos

Your cost list is the right instinct. In my experience Lakebase doesn't surprise people on the compute rate, it surprises them on the multipliers around it: retention window, branches, sync pipelines, and Always-On sizing. You can only settle most of...

  • 3 kudos
1 More Replies
Pravieen
by > • New Contributor
  • 294 Views
  • 3 replies
  • 0 kudos

Request for Guidance: Enabling PostgreSQL CDC in Azure Databricks Lakeflow Connect

Hello Databricks Community,I am using Azure Databricks Lakeflow Connect with a PostgreSQL source.The CDC option is disabled in the PostgreSQL ingestion wizard, and I see the following message:This mode is not available in this workspace for the selec...

  • 294 Views
  • 3 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

The message means that CDC mode for the PostgreSQL connector isn't turned on for your workspace. It isn't a problem with your connection or source configuration. Since you already have a ticket open, that's the right path, but there are a couple of ...

  • 0 kudos
2 More Replies
krishgarikipati
by > • Databricks Partner
  • 286 Views
  • 3 replies
  • 0 kudos

Delta Tables: Is there any possibility on Delta tables Data file formats other than Parquet

Hi Team,Since Parquet files are immutable and Delta tables framework writes data changes into new data files, Is there any option to specify any other file format and try to use same data file for minor data changes.(Below 10 Record transaction chang...

  • 286 Views
  • 3 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

Short answer: No, you can't swap Parquet for another file format in Delta. Delta Lake is Parquet data files plus a file-based transaction log [1]. What you're really after, avoiding a rewrite of huge files for a handful of changed rows, is handled b...

  • 0 kudos
2 More Replies
ZindeshaAshiq
by > • New Contributor
  • 370 Views
  • 10 replies
  • 0 kudos

Not able to use 'Serverless Starter Warehouse'

Hey, I have recently started using Free Edition and since beginning, I am getting this issue.I have tried to run this warehouse but could not resolve it on my own. What can be done ?

ZindeshaAshiq_0-1794937644818.png
Get Started Discussions
compute
Serverless Starter Warehouse
  • 370 Views
  • 10 replies
  • 0 kudos
Latest Reply
ZindeshaAshiq
New Contributor
  • 0 kudos

 Hi @Louis_Frolio , Thanks for the update. As mentioned earlier, As a free edition user, I am not able to delete a warehouse. I can still execute sql queries in notebook. However, there are some tasks which needs SQL Warehouse to run.So, After few ch...

  • 0 kudos
9 More Replies
jumelik
by > • New Contributor
  • 161 Views
  • 2 replies
  • 1 kudos

Hourly streaming table refresh jobs keep running after the table was dropped (Free Edition)

I’m using Databricks Free Edition. I created the streaming table retail_analytics.sales_data.customers_latest with SCHEDULE EVERY 1 HOUR and later dropped the table. Two refresh jobs with the same name still run hourly and send failure emails.Job 516...

  • 161 Views
  • 2 replies
  • 1 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 1 kudos

The hourly runs come from orphaned scheduler jobs. Dropping the streaming table should have removed them, but it didn't. That's why DROP SCHEDULE fails: it's an ALTER on the table, and the table no longer exists. The fix has to go through the Jobs l...

  • 1 kudos
1 More Replies
YuriS
by > • New Contributor III
  • 232 Views
  • 4 replies
  • 0 kudos

DEEP CLONE fails with DELTA_CLONE_INCOMPLETE_FILE_COPY

Hi, Would appreciate some support on the DELTA_CLONE_INCOMPLETE_FILE_COPY issue with DEEP CLONE.Exact error is as follows: An error occurred while calling o459.sql.: org.apache.spark.SparkException: Job aborted due to stage failure: Task 144 in stage...

  • 232 Views
  • 4 replies
  • 0 kudos
Latest Reply
anuj_lathi
Databricks Employee
  • 0 kudos

Short answer: I wouldn't set spark.databricks.delta.clone.checkWrite to false. That check is a safety net. DEEP CLONE compares the size of each file it wrote against the size recorded in the source table's transaction log. Expected 146660 and found ...

  • 0 kudos
3 More Replies
Welcome to the Databricks Community!

Once you are logged in, you will be ready to post content, ask questions, participate in discussions, earn badges, and more.

Spend a few minutes exploring Get Started Resources, Learning Paths, Certifications, and Platform Discussions.

Join Learning Events here in the Community.

Connect with peers through Databricks User Groups and learn more about Community Events happening near you. We’re excited to see you get involved.

Top Kudoed Authors

Latest from our Blog

Reading Unity Catalog Tables in Snowflake

Introduction A core requirement for AI and analytics adoption is the ability to access data from multiple systems, databases, and SaaS applications without duplicating it. Multiple copies of data intr...

107Views 0kudos

Private connectivity from Databricks on AWS to Amazon S3

Table of contents Why secure connectivity mattersKey conceptsUnity Catalog Access to S3 - Authentication and PermissionsClassic compute connecting to your S3 buckets S3 gateway endpointS3 interface en...

301Views 1kudos