What if we want to ingest data incrementally without CDF? than we have new functionality from Databricks "query-based capture", which is nothing less than watermark-based incremental ingestion. It seems to be another Best Practice solution for incremental data loading.

https://databrickster.medium.com/watermark-based-incremental-ingestion-lakeflow-connect-query-based-...
https://www.sunnydata.ai/blog/lakeflow-connect-query-based-capture-incremental-ingestion