Hi @yit337 ,The behavior you are seeing is expected. ONCE means “run once for the current pipeline state,” not “never run again.” A full refresh clears the Gold table and its flow checkpoints, so the ONCE flow runs again and the CDF flow can replay r...
Hi @Yogasathyandrun ,Your diagnosis is correct. As of now, Lakebase CDF/WAL2Delta does not support a Unity Catalog destination whose managed storage is reachable only through an Azure private endpoint with public network access disabled.This is how I...
Use one Auto Loader streaming table per object type, generated from a governed configuration registry; not dbutils.fs.ls. Each object type needs an independent schema and checkpoint. Auto Loader cannot use one CSV stream to infer unrelated schemas a...
That version should work although documentation doesn't list it yet. Can you try out? If it fails I would recommend opening a support case with your workspace ID and the exact error message so the team can verify the allowlist status.
