cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

**Lakeflow Connect SQL Server — Snapshots Firing Outside Configured Full Refresh Window?**

lrm_data
New Contributor

Has anyone else seen full refresh snapshots trigger outside of their configured refresh window in Lakeflow Connect?

Here's our situation:

- We have a full refresh window configured to restrict snapshot operations to off-hours
- On at least one occasion, a snapshot started outside of that window — during business hours
- This caused unintended load on our SQL Server source during peak usage

The docs are clear that snapshots should only start during the next available time in the configured window, so this feels like unintended behavior. I'm still investigating whether there's a specific trigger (e.g. auto full refresh policy, a pipeline retry) that might bypass the window, but so far I haven't been able to pin down a consistent cause.

Has anyone else observed this? And if so, have you found any conditions that reliably cause a snapshot to ignore the configured window?

Would love to know if this is a known bug or if there's something in our configuration we should be looking at.

1 REPLY 1

Sumit_7
Honored Contributor II

@lrm_data This is very unlike case for the refresh to be triggered outside the configured window. Though I would still suggest to check the Configured Window and Auto Full Refresh policy once to be sure.
If still persists, then you may raise a support ticket for further resolution.