Hello,

May someone please Help me designing the Error Logging and How to do orchestration for Pipeline below.

I am pulling data from Bronze layer and pushing it to silver layer after transformation.

1. How to do Error Logging and where to store

2. How to orchestrate this pipeline. Can we do with Databricks itself.

Thanks a lot for your kind help