Mastering Databricks ABAC
As data landscapes grow increasingly complex, traditional role-based access control (RBAC) is hitting its limits. Data engineers are facing “role explosion” scenarios where man...
Blog Articles
How to Anonymize Vehicle Data with Databricks Delta Live Tables (DLT)
In the age of connected cars and telematics, organizations collect massive volumes of vehicle data—GPS coordinates, VINs, driver IDs, diagnostic readings, and more. While this data is a goldmine for a...
Auto Loader: Data Ingestion with built-in Data Audit & Validation
Introduction: Auto Loader as the Go-To Ingestion Solution Databricks Auto Loader has become the standard for incremental data ingestion in cloud environments. It provides automatic schema inference, h...
Apache Spark 4.0 – A New Era for Scalable Machine Learning and AI
As a machine learning practitioner, I’m incredibly excited about the release of Apache Spark 4.0 (officially announced May 23, 2025). This landmark update brings a bevy of new features and improvement...
NVIDIA’s AI-Native Digital Twin on Databricks, True AI Democratization for Telecom I
The telecommunications industry is on the verge of transformation, driven by the emergence of AI-native digital twins and open-source simulation tools that Nvidia released during the GTC 2025 conferen...
My First Experience at the Data + AI Summit: Highlights and Reflections
Attending the Data + AI Summit 2025 in San Francisco in person for the first time was an exceptional experience. As a Databricks MVP, author, instructor, and data engineer with over a decade of experi...
Batch and Interactive Inference with XGBoost using Databricks ai_query()
ai_query() is a built-in Databricks SQL function that lets you invoke a model serving endpoint from a SQL query. This enables data scientists to apply machine learning models (including traditional ML...
NVIDIA’s AI-Native Digital Twin on Databricks, True AI Democratization for Telecom II
In this article, we want to put the Sionna digital twin into practice and see if it would help RF engineers simulate the changes before implementing them. We implement coverage in a complex urban envi...
Iceberg Interoperability (Databricks <> Snowflake)
Iceberg Interoperability (Databricks <> Snowflake) In this post, we’ll explore the two main approaches to integrating UC with other Iceberg environments — Foreign Iceberg tables and Managed Iceberg ta...
[CUSTOMER] Smarter Maps, Smarter Markets: Geospatial GenAI for Real Estate Investment
When exploring a neighborhood, it’s easy to observe the businesses that already thrive there and imagine the potential opportunities for a piece of real estate. What if GenAI could take the wheel by a...
- Fizzle on: How to Anonymize Vehicle Data with Databricks Delt...
- TheOC on: My First Experience at the Data + AI Summit: Highl...
- szymon_dybczak on: Ray on Spark: A Practical Architecture and Setup G...
- szymon_dybczak on: Routing Optimization on Databricks
- Sharanya13 on: [Partner Blog] Introduction to Databricks Lakebase...
- FedeRaimondi on: Customizing Target Deployments in Databricks Asset...
-
Krishna_S on: SAP Databricks the force within SAP BDC to unlock ...
- Sharanya13 on: Efficient Data Ingestion from SQL Server with Lake...
- vivekbandi7777 on: How to use AI Guardrails using Mosaic AI Gateway?
- TheOC on: Collaborative Data Engineering Made Simple with Da...