- 188 Views
- 1 replies
- 0 kudos
Tech Companies & Lakeflow Connect
Hello fellow techies,For the past few days I have been doing some R&D wrt Lakeflow connect. I came to the understanding that, Lakeflow Ingestion Pipeline and SQL server connection have a 1:1 mapping. This would mean that as number of servers scales n...
- 188 Views
- 1 replies
- 0 kudos
- 0 kudos
Most modern enterprise data platforms favor managed ingestion (Lakeflow Connect) for standard relational databases like SQL Server. The operational complexity of monitoring 50 managed pipelines is significantly lower than maintaining custom CDC code,...
- 0 kudos
- 770 Views
- 3 replies
- 1 kudos
Lakeflow jobs file trigger thru overwritten files
Is there any way a job can be triggered with overwritten files through a file trigger?I knew the limitations, but I just want to have other opinions or solutions.LimitationsOnly new files trigger runs. Overwriting an existing file with a file of the ...
- 770 Views
- 3 replies
- 1 kudos
- 1 kudos
Hi @DazzaiDe, Unfortunately, you can't do that as of today. Is there a specific reason you want to maintain the same name for the triggers? Instead of linking to a static file name, could you point to a root path so that any new files will trigger th...
- 1 kudos