- 501 Views
- 1 replies
- 2 kudos
Databricks Lake flow - Orchestration Layer is moving to where it belongs
Discussed the BI & Metrics Tax elimination using Databricks Metric Views here. Organizations also face an older more persistent tax — the Ingestion Tax.To ingest data from a source like Salesforce or SQL Server into your Lakehouse, you typically stit...
- 501 Views
- 1 replies
- 2 kudos
- 2 kudos
The point about “ingestion tax” is interesting because tooling sprawl can create hidden costs beyond the actual software licenses. Fragmented pipelines, maintenance work, and governance gaps can all add operational overhead as data environments grow....
- 2 kudos
- 635 Views
- 4 replies
- 5 kudos
Visual, step-by-step curriculum for mastering DABs and Infrastructure as Code
Most public GitHub repositories for Databricks are just dry code dumps. You get a massive YAML file, a basic README, and are expected to just figure it out.When building production-grade infrastructure, engineers need to see the architecture and unde...
- 635 Views
- 4 replies
- 5 kudos
- 5 kudos
Great resource—visual architecture and real-world DABs examples make this much easier to learn and apply in production.
- 5 kudos
- 241 Views
- 0 replies
- 1 kudos
Sales Pipeline Coach: Turning CRM Data Into a Conversation
Every sales manager I've ever talked to has the same quiet frustration: the CRM has all the answers, but getting to them takes forever. You want to know which deals are actually at risk this week, and instead you're pivoting spreadsheets, cross-refer...
- 241 Views
- 0 replies
- 1 kudos
- 194 Views
- 0 replies
- 1 kudos
Unity Catalog Schemas in Declarative Automation Bundles Are a Footgun
Last week a teammate ran databricks bundle deploy against our dev workspace. It failed on a schema that already existed. She had not touched that schema. Nobody had. Her code was identical to mine, and my deploy had worked ten minutes earlier.The cau...
- 194 Views
- 0 replies
- 1 kudos
- 158 Views
- 0 replies
- 0 kudos
Databricks Connect + Serverless: Why "Module Not Found" Shows Up Only in CI, Not Interactively
A pattern that shows up repeatedly when people move a working Structured Streaming pipeline from "runs fine in a workspace notebook" to "runs in CI via Databricks Connect against serverless" is a ModuleNotFoundError that only appears in the second co...
- 158 Views
- 0 replies
- 0 kudos
- 148 Views
- 0 replies
- 1 kudos
Databricks Connect + Serverless: Why "Module Not Found" Shows Up Only in CI, Not Interactively
A pattern that shows up repeatedly when people move a working Structured Streaming pipeline from "runs fine in a workspace notebook" to "runs in CI via Databricks Connect against serverless" is a ModuleNotFoundError that only appears in the second co...
- 148 Views
- 0 replies
- 1 kudos
- 231 Views
- 1 replies
- 2 kudos
🇪🇸 ☕ ¿Cómo organiza Databricks tus datos? | De Unity Catalog a Delta Lake ⚡
Aquí os dejo mi nuevo vídeo sobre Databricks para la comunidad de hablantes en español. Se recorre la arquitectura de datos de Databricks desde el Workspace hasta los archivos Parquet que almacenan físicamente la información.El objetivo no es simplem...
- 231 Views
- 1 replies
- 2 kudos
- 2 kudos
Correct video is here:
- 2 kudos
- 130 Views
- 0 replies
- 1 kudos
☕ Qué es un CLUSTER en Databricks | Tipos, DBR, Serverless, Costes, DBUs y Spot Instances 🇪🇸 🚀
Nuevo video para la comunidad de Databricks en español Todo el mundo usa clusters en Databricks… pero ¿sabes realmente qué ocurre cuando pulsas RUN?Driver. Workers. DBUs. Serverless. Photon. Autoscaling. Spot Instances…Conceptos que parecen independ...
- 130 Views
- 0 replies
- 1 kudos
- 21331 Views
- 14 replies
- 35 kudos
Zero to Hero - Data Analysis Certification
Hey everyone, Today I passed my Data Analyst Associate exam! 拾I'd like to say thanks to the Databricks community. The questions that people ask and interactions I've been a part of have been invaluable. Starting tomorrow, I'll be moving onto my data ...
- 21331 Views
- 14 replies
- 35 kudos
- 35 kudos
Anyone used or recommend Skillcertpro preparation guide for certification ?
- 35 kudos
- 238 Views
- 0 replies
- 0 kudos
Learn Databricks Agent Bricks | Build Enterprise RAG Agents
Databricks Training & Certifications Learn Databricks Agent Bricks Build, retrieve, and ship production-ready AI agents on your own data. Retrieval (RAG) 易 Knowledge Assistants Vector Search Want to build AI age...
- 238 Views
- 0 replies
- 0 kudos
- 425 Views
- 0 replies
- 1 kudos
Solution Accelerator Series | Overall Equipment Effectiveness
Manufacturers collect large volumes of sensor and equipment data, but measuring equipment productivity at the required latency and scale can be difficult with traditional systems. The Overall Equipment Effectiveness (OEE) Solution Accelerator demonst...
- 425 Views
- 0 replies
- 1 kudos
- 215 Views
- 0 replies
- 0 kudos
Configure Databricks Access to Keyvault with Azure Role Based Access Control (RBAC)
Set up required : Key vaultgo to settings: Access Configuration, check Azure Role Based Access control under permission modelgo to Network: Allow trusted azure services to send requestCreate Access connector for Databricks from portalgo to IAM in KV ...
- 215 Views
- 0 replies
- 0 kudos
- 571 Views
- 5 replies
- 16 kudos
From 40 Minutes to 8 minutes: Why We Dropped MERGE in Our SAP BW to Databricks Gold Layer
Infra keeps getting faster, but the fix for a slow notebook is usually a config line, not a bigger cluster.One Spark Config, 32 Minutes Saved: Replacing MERGE with Dynamic Partition OverwriteBy @Phani_sannala , co-authored with @sridharplv Our gold n...
- 571 Views
- 5 replies
- 16 kudos
- 16 kudos
The zombie row bug is the real argument here reframing this from "MERGE is slow" to "MERGE is silently wrong for full-slice delivery" is what makes it land. Only thing I'd stress: dynamic partition overwrite is exactly as safe as your completeness ch...
- 16 kudos
- 436 Views
- 2 replies
- 2 kudos
Change Data Feed on Materialized Views Why I Think This Is More Than an Incremental Processing
One interesting way to look at CDF on Materialized Views is the difference between source-level change and business-level change.CDC might tell us that five banking transactions changed. But after those transactions pass through our transformations,...
- 436 Views
- 2 replies
- 2 kudos
- 2 kudos
Good point, @AmitDECopilot that gap between "row changed" and "value actually changed enough to matter" is where most CDC setups trip up. We hit the same thing on a Gold-layer project: CDF told us data moved, but teams really wanted to know "did the...
- 2 kudos
- 277 Views
- 0 replies
- 0 kudos
Exploring Databricks Instructed-Retriever-1 Through a Data Engineering Use Case
I have been exploring the architecture behind Agent Bricks Knowledge Assistant, particularly the relationship between Instructed Retriever and the newer Instructed-Retriever-1 model.One practical question helped me understand the difference:“The prod...
- 277 Views
- 0 replies
- 0 kudos
| User | Count |
|---|---|
| 85 | |
| 75 | |
| 72 | |
| 60 | |
| 43 |
