topic Re: Delta Live Tables - skipChangeCommits in SQL in Data Engineering

Delta Live Tables - skipChangeCommits in SQL

thedatacrew — Tue, 14 Jan 2025 15:09:49 GMT

Hi,

Could anyone tell me if the skipChangeCommits option is supported in SQL mode? I can use it successfully using Python, but it doesn't look like it is supported by SQL.

It seems to be a glaring omission from the SQL support, or support for this will come later. Does anyone know the answer?

Thanks

Re: Delta Live Tables - skipChangeCommits in SQL

Alberto_Umana — Tue, 14 Jan 2025 15:11:42 GMT

Hi @thedatacrew ,

The skipChangeCommits option is not supported in SQL mode for Delta Live Tables (DLT). About future support I will check internally.

Re: Delta Live Tables - skipChangeCommits in SQL

thedatacrew — Tue, 14 Jan 2025 15:45:43 GMT

Thanks, Alberto. It would be great to know if it's in the roadmap.

Re: Delta Live Tables - skipChangeCommits in SQL

thedatacrew — Mon, 20 Jan 2025 13:05:34 GMT

Hi Alberto,

Did you manage to get an answer?

Thanks

Toby

Re: Delta Live Tables - skipChangeCommits in SQL

Alberto_Umana — Mon, 20 Jan 2025 13:11:06 GMT

Hi @thedatacrew,

Thanks for reaching out! I see there is already a feature request in place and it's open. https://databricks.aha.io/ideas/ideas/DB-I-12966

You might not have access to it, but you can follow up with your account team on above idea to be considered for its implementation and support.

Re: Delta Live Tables - skipChangeCommits in SQL

thedatacrew — Mon, 20 Jan 2025 14:12:15 GMT

Thanks, I do no have access to it. I take it there no timeline on it.

Re: Delta Live Tables - skipChangeCommits in SQL

Alberto_Umana — Mon, 20 Jan 2025 14:30:01 GMT

Unfortunately there is no ETA on this yet. If I know about it, will let you know!