Originally went with the approach of exporting to and reading from the event log table, which has been helpful for getting other metrics as well.

Also found today that there is a new system table is in public preview which exposes the durations I was looking for without the need for additional configuration on the pipelines. Wanted to record that here as well
https://docs.databricks.com/aws/en/admin/system-tables/jobs#pipeline-update-timeline

Thanks all