cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
ShamenParis
Contributor III
since ‎05-22-2026
yesterday

User Stats

  • 58 Posts
  • 12 Solutions
  • 18 Kudos given
  • 37 Kudos received

User Activity

How to force Databricks Serverless to process 1 TB (40 Billion Rows) in 14 Minutes

2 weeks ago
Databricks Serverless is incredible for abstracting infrastructure, but because it scales based on the volume of pending tasks, relying on default configurations for massive data ingestion can leave performance on the table.I recently ran an experime...

I Built an AI-Powered Data Pipeline Generator for Databricks — Here Is What Happened

2 weeks ago
Building robust Medallion architectures takes time. Writing the same boilerplate for Auto Loader, streaming tables, and SCD Type 2 merges across different projects is a bottleneck.So, I ran an experiment: What happens if you let AI write your Spark D...

Visual, step-by-step curriculum for mastering DABs and Infrastructure as Code

08-14-2026
Most public GitHub repositories for Databricks are just dry code dumps. You get a massive YAML file, a basic README, and are expected to just figure it out.When building production-grade infrastructure, engineers need to see the architecture and unde...

Demystifying Databricks Full Text Search: It’s Not Vector Search (And That’s Okay!)

08-04-2026
Vector search is everywhere right now, but is it always the right tool for the job? Actually, noIf you need to find a specific Trace ID or error code buried in 100 million log rows, you don't want an AI model guessing what's "conceptually similar." Y...

Automating Databricks Lakeflow Connect Pipelines for CDC Databases

06-06-2026
Hi all,Tired of paying the data movement tax or wrestling with complex manual pipeline configs?I just published a new Medium article and open-sourced a framework that fully automates Databricks Lakeflow Connect pipelines for CDC-enabled databases usi...
View more