Databricks Community

suryaprayaga

Recently I started socializing the use of Genie and Databricks to even a laymen (and ofcourse laywomen) who have never heard what coding is in their life. I am proud that in my company nearly 200 people as of now are using Databricks for some or othe...

suryaprayaga

Folks, I must admit, at the beginning I was apprehensive of using Genie for almost anything. Now it solves almost anything that I want to code on Databricks. I was more fascinated with it when I learnt that our customer (who is one of the largest Tel...

suryaprayaga · 08-12-2026

As part of flawless data governance and data quality implementation, Data Drift metrics play a very important role. I have compiled a few Data Drift metrics like Jensen-Shannon Divergence Score, Correlation Breakdown Detection, Data Lineage Health an...

suryaprayaga · 08-10-2026

I wonder if there is any GitHub that specifically focuses on Databricks' Lakehouse monitoring solution with definitions and codes that can do this.I want to onboard it for a customer of mine and don't want to write from scratch if one is already pres...

suryaprayaga · 08-05-2026

Hello.There are a lot of webinars and events / meetings that happened in the past. Is there a way where we can get those recordings of events? Surya

suryaprayaga

This is a good question. Databricks Auto Loader specifically supports a "rescue schema-evolution" mode where new columns don't cause the stream to fail; unexpected fields are placed into a rescued-data column. Besides we could safely introduce what i...

suryaprayaga

Dear Thomaz,Thank you for your kind reply and yes Genie has solved many complex problems we work with our customers with. When I said our customers are using it in their Data Science pipeline, I meant using Genie to write codes to build Propensity Mo...

suryaprayaga

Yes that's true. There are hundreds (if not 100s) of tasks that can be done without depending on the agents. Databricks indeed has DQX for governance and data quality. Instead of relying on smaller activities (especially when they are repeating in na...

suryaprayaga

Tushar, this is interesting. What I am otherwise thinking to represent this as a workflow is depicted in this image.

suryaprayaga · 08-12-2026

Balaji, this is an amazing list. I will use a few of them in my POC to start with. Great reply.

Databricks Community

User Stats

User Activity

Genie Use Cases & easy adaptibility

Power of Genie

Data Drift Metrics

Lakehouse Monitoring Solution

Video Recordings of Previous Webinars

Re: Schema changes notification

Re: Power of Genie

Re: I Stopped Sending Every Data Engineering Task to an LLM - A Cost Aware Routing Pattern on Databr

Re: Announcement | Operationalizing Genie Ontology in Your Data Stack

Re: Data Drift Metrics