Get Started Resources
Explore essential resources to kickstart your journey with Databricks. Access tutorials, guides, and...
0 Posts
Activity in Resources
- 762 Views
- 2 replies
- 4 kudos
A New Era of Databases: Lakebase
Databases have powered software for decades, but their underlying architecture hasn’t kept pace with modern application needs—especially in the era of AI and rapid development. Lakebase introduces a new approach by separating compute from storage an...
- 762 Views
- 2 replies
- 4 kudos
Latest Reply
- 4 kudos
What is your point of view on Provisioned instances Vs Autoscaling instances.
- 4 kudos
- 101 Views
- 2 replies
- 9 kudos
Sub-Second Agents for the Databricks Community: A Lakebase Pattern for Instant Context
By Mandy Ross and Mitchell Grewer At Databricks, we innovate in every department. Most recently, the Community team solved a tricky problem by building an internal app and as part of that process, reduced our in-app AI assistant’s time-to-first-respo...
- 101 Views
- 2 replies
- 9 kudos
Latest Reply
- 9 kudos
It's an absolute pleasure collaborating with the community team! It's so cool to see this engagement pattern live, where the agent (CORA) engages when the page loads instead of the user having to type a question.
- 9 kudos
- 23 Views
- 0 replies
- 0 kudos
CI/CD using Workload Identity Federation
Most Databricks deployment pipelines on Azure still authenticate with a service principal client secret. There is a better way and it does not require managing a single credential. The standard pattern has a quiet problemIf you have set up Databricks...
- 23 Views
- 0 replies
- 0 kudos
- 19 Views
- 0 replies
- 0 kudos
5 Minute Features - a new video series
I have spent the past couple of months building up a small hobby YouTube project where I run through Databricks Features in an easy to digest format.I am for a very hands-on and demo heavy approach so you can actually see what is going on, and how th...
- 19 Views
- 0 replies
- 0 kudos
- 27 Views
- 1 replies
- 0 kudos
I built ar-io-mlflow: Open-Source MLflow Plugin for Verifiable & Tamper-Proof AI Provenance
Hey everyone!I've built and open-sourced ar-io-mlfow. This is a plugin that adds cryptographic provenance across the ML lifecycle (training runs, model registration, stage promotions, inference, and datasets).What it doesCreates signed Ed25519 crypto...
- 27 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
I also opened a discussion on Github, not sure which is the right place sorry if this isn't it - https://github.com/mlflow/mlflow/discussions/23355
- 0 kudos
- 14172 Views
- 13 replies
- 42 kudos
From Associate to Professional: My Learning Plan to ace all Databricks Data Engineer Certifications
In today’s data-driven world, the role of a data engineer is critical in designing and maintaining the infrastructure that allows for the efficient collection, storage, and analysis of large volumes of data. Databricks certifications holds significan...
- 14172 Views
- 13 replies
- 42 kudos
Latest Reply
- 42 kudos
Hello , can u hep me with study material for associate level exam, where do we get it? the free version if possible? any noteS?
- 42 kudos
- 33 Views
- 0 replies
- 0 kudos
Agent Bricks in Action: Automating Insurance Underwriting with a Supervisor Agent-Led Architecture
About three years ago, when Generative AI was still in its early stages, I worked on a commercial application for insurance underwriting. It was a Life Insurance Underwriting assistant built on an early version of GPT-4 (1106).The design was simple. ...
- 33 Views
- 0 replies
- 0 kudos
- 22 Views
- 0 replies
- 0 kudos
Real-Time Voice AI on Databricks with Vocal Bridge and Lakebase
In one of the recent issue of The Batch, Andrew Ng argues that voice UIs will become as ubiquitous as the mouse and touchscreen - and highlights Vocal Bridge, an agentic voice platform, as an example of the infrastructure making this possible. To dem...
- 22 Views
- 0 replies
- 0 kudos
- 40 Views
- 0 replies
- 0 kudos
Global job parameters
Global job parameters were always my dream. Additionally, centralized config for DABs. It is now possible thanks to Mutators! #databricks https://databrickster.medium.com/global-job-parameters-thanks-to-dabs-mutators-2ad0d94bda1chttps://www.sunnydata...
- 40 Views
- 0 replies
- 0 kudos
- 90 Views
- 0 replies
- 0 kudos
Solution Accelerator Series | Media Mix Modeling (MMM)
In today’s media landscape, it can be difficult to know which marketing channels are driving results. The Media Mix Modeling (MMM) Solution Accelerator helps organizations bring together data from channels such as TV, social media and email marketing...
- 90 Views
- 0 replies
- 0 kudos
- 36 Views
- 0 replies
- 0 kudos
Why centralized state forces distributed reconstruction — a three-part series
Hi everyone — wanted to share a three-part series I recently published on Medium that examines architectural patterns from a real Databricks-based data consolidation project.The specific case is a logistics platform unifying two legacy systems into a...
- 36 Views
- 0 replies
- 0 kudos
- 69 Views
- 0 replies
- 0 kudos
Unity Catalog: New ABAC & Data Classification Tools Now GA
Databricks has announced general availability for ABAC row filtering and column masking, governed tags, and data classification in Unity Catalog, bringing policy, tagging, and sensitive-data discovery into one governance framework for protecting data...
- 69 Views
- 0 replies
- 0 kudos
- 10977 Views
- 1 replies
- 3 kudos
Re-ingesting Data with Auto Loader
So imagine, you are a Data Engineer using Databricks Auto Loader to ingest data from cloud storage, when you suddenly realize that recently ingested data has some problem and you’d like to simply delete it from the bronze layer and re-ingest it. Thi...
- 10977 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
It's been 2 years since this post. Could you please confirm if there has been any update to the AutoLoader feature to handle this situation of "back-up, fix the problem, then continue on" ?
- 3 kudos
- 58 Views
- 0 replies
- 1 kudos
Genie One Menu
It starts to look busy in Genie One Menu #databricks https://databrickster.medium.com/databricks-news-lakeflow-designer-uv-package-manager-genie-tasks-disable-lakeflow-tasks-3e2cfb9ef86b
- 58 Views
- 0 replies
- 1 kudos
- 59 Views
- 0 replies
- 0 kudos
From Fragmented Schedulers to Unified Orchestration: A Lakehouse Evolution
This article wraps up a technical deep dive into building large-scale Lakehouse architectures, revisiting design decisions from a 2019 platform that processed billions of payment records.In the original platform, streaming pipelines ran on Spark Stre...
- 59 Views
- 0 replies
- 0 kudos
| User | Count |
|---|---|
| 1252 | |
| 686 | |
| 231 | |
| 179 | |
| 160 |
