Lakeflow jobs

Nidhig
Databricks Partner

 

Hi 
I am currently working on migrating all ADF jobs to LakeFlow jobs. I have a few questions:

  • Pipeline cost: What is the cost model for running LakeFlow pipelines? Any documentation available? ADF vs Lakeflow Job?

  • Job reuse: Do LakeFlow jobs reuse the same compute/job for each notebook activity, or is each notebook run treated as an independent job?

  • Event-based triggers: It seems event-based triggering won’t work when the same file name is used. Is there any workaround for this? Keeping  in mind for migration, cannot change existing setup file name will be same every time.