Hi again @Akshay_Petkar  !

I don't think that all values must be stored in Azure Key Vault. it depends on which Lakebridge reconciliation config version or path you are using.

For the older notebook style config, Lakebridge has a secret_scope for source connection credentials and DatabaseConfig still needs the source or target catalog and schema values. If you check the doc secret_scope, source_schema, target_catalog, target_schema and optional source_catalog are part of the reconciliation config. https://databrickslabs.github.io/lakebridge/docs/reconcile/recon_notebook/

The important clue is this None.database_name.table_name whichnormally means one of the catalog values is being resolved as none not that Spark is slow.

If this answer resolves your question, could you please mark it as “Accept as Solution”? It will help other users quickly find the correct fix.

Senior BI/Data Engineer | Microsoft MVP Data Platform | Microsoft MVP Power BI | Power BI Super User | C# Corner MVP