Databricks Community

data_pulse

Databricks' Governed Tag Propagation (Beta) is an interesting addition to Unity Catalog, helping automatically carry governed tags across downstream tables and views using data lineage.As data moves across medallion layers, this could significantly r...

data_pulse

When teams start looking at Databricks cost, the first instinct is usually to query system.billing.usage.That gives a good view of Databricks consumption, but it is only one part of the overall cost picture..For a more complete FinOps view on Azure, ...

data_pulse

Databricks mentions in the DBR 19 release notes that Auto CDF removes write-time overhead and can make MERGE and UPDATE operations about 15% faster on tables queried for changesFor anyone who has moved an existing pipeline from legacy CDF to Auto CDF...

data_pulse · 09-11-2026

Hello Community.We recently enabled the following option on several existing Auto Loader streams:"cloudFiles.useManagedFileEvents": "true"Most streams continued working, but one now fails while restoring its existing checkpoint, referencing a file si...

data_pulse · 09-09-2026

I am looking at a scenario for team-level cost attribution using system.billing.usage and have a tagging gap for Databricks-managed services such as Predictive Optimization and Data Quality Monitoring.Tried adding a team/ownership tag directly to the...

data_pulse

@harsh120 I tried reproducing this with a similar setup using nested permanent Unity Catalog views, including SELECT DISTINCT, a date-range LEFT JOIN, a temporary view and the subsequent MAP()/filter transformations with isEmpty().Both steps passed o...

data_pulse

Adding to the good suggestions already shared around DLT event logs and CDF, a couple of newer Databricks capabilities may help operationalise this monitoring.1. Lakeflow Pipeline Events system table (Beta)Databricks now provides a centralised system...

data_pulse

@volodymyr_b The SQL Server connector reference confirms that UNIQUEIDENTIFIER is automatically converted to STRING, which makes the ordering behaviour you've identified worth investigating.I ran a few independent test using SQL Server and Databricks...

data_pulse

@Y-Caura This looks potentially related to account/workspace provisioning after the Express Setup upgrade, let's first verify the effective network-policy enforcement Check serverless egress denial logs: Databricks documents system.access.outbound_ne...

data_pulse

@Ram_Sundar +1, I am seeing the same behaviour as-well. I tried the available editor settings (Autocomplete as you type, Automatic Genie Code Autocomplete, and the keyword/function casing options) and none of them changes the casing of CTE column sug...

Databricks Community

User Stats

User Activity

Governed Tag Propagation (Beta) in Unity Catalog - How It Works and What to Consider

Building an End-to-End FinOps Cost Attribution Model for Azure Databricks

Anyone migrated from legacy CDF to Auto CDF yet?

Auto Loader stream fails on RocksDB checkpoint after enabling managed file events

Do UC table tags propagate to billing for Predictive Optimization and Data Quality Monitoring?

Re: Table does not support batch scan.

Re: How to Track Hourly or Daily # of Upsert/Delete Metrics in a DLT Streaming Pipeline

Re: Possible bug in Lakeflow Connect SQL Server ingestion with GUID primary keys – Missing records

Re: Serverless egress blocked despite FULL_ACCESS network policy

Re: Issue with query editor - auto suggest does not respect the casing of columns in CTE