Databricks Community

binlogreader

Hi All, I need an up-to-date plain Delta copy of a streaming table created by Lakeflow pipeline. My first thought was CLONE, and that path is closed. The clone docs say streaming tables and materialized views cannot be the source or target of a deep ...

binlogreader

Hi All,I'm evaluating metadata-driven frameworks for Lakeflow Spark Declarative Pipelines, and I've found two that appear to serve the same purpose, both from Databricks organizations:- databrickslabs/dlt-meta, whose feature/sdp-meta branch renames t...

binlogreader

Helpful direction, thank you!

binlogreader

Streaming MV worked! You sir saved me a lot of time. Many thanks.

binlogreader

Sound discussion overall in this thread. Two hard earned lessons that came out of running this in production that I can think of sharing:(1) Rehearse the cleanup on a scratch table before relying on it: point your reader at a test table, expire snaps...

binlogreader

@ajaygshah Between using SDP expectations and DQX, what influenced your choice? We are evaluating the two tools, and I am curious to hear your experience.

binlogreader

On AWS, all private connectivity from serverless compute runs through a network connectivity configuration. The NCC is an account-level object that holds private endpoint rules, and attaching it to a workspace is what routes serverless traffic throug...

Databricks Community

User Stats

User Activity

How do you keep a plain Delta copy of a streaming table? CLONE is not supported on streaming tables

sdp-meta (dlt-meta) vs lakeflow_framework: when should we use which?

Re: sdp-meta (dlt-meta) vs lakeflow_framework: when should we use which?

Re: How do you keep a plain Delta copy of a streaming table? CLONE is not supported on streaming tab

Re: Does VACUUM on Delta Lake also clean Iceberg metadata when using Iceberg Uniform feature?

Re: What are powerfull data quality tools/libraries to build data quality framework in Databricks ?

Re: NCC private endpoint cannot be added