Databricks Community

YuriS

Let’s say we have big data application where data loss is not an option.Having GZRS (geo-zone-redundant storage) redundancy we would achieve zero data loss if primary region is alive – writer is waiting for acks from two or more Azure availability zo...

YuriS · 04-18-2025

Could someone please advise regarding VACUUM with Azure Storage Inventory Report as i have failed to make it work.DBR 15.4 LTS, VACUUM command is being run with USING INVENTORY clause, as follows:VACUUM schema.table USING INVENTORY ( select 'https://...

YuriS

@mark_ott Mark, thank you for so detailed response.We are currently evaluating two approaches for seamless, lossless failover with full integrity in stateless streaming scenarios. 1) Parse Databricks Offsets files and2) Enable row trackingthat we’ve...

YuriS · 04-22-2025

After additional investigation it turned out the proper "fully-qualified-URL" path should be'dbfs:/mnt/...''dbfs:/mnt/{endpoint}/' || ir.Name as path,and not 'https://xxx.blob.core.windows.net/' || ir.Name as path,

Databricks Community

User Stats

User Activity

How to reduce data loss for Delta Lake on Azure when failing from primary to secondary regions?

VACUUM with Azure Storage Inventory Report is not working

Re: How to reduce data loss for Delta Lake on Azure when failing from primary to secondary regions?

Re: VACUUM with Azure Storage Inventory Report is not working