Hubert-Dudek
Databricks MVP

Maybe better approach will be to use dlt meta https://databrickslabs.github.io/dlt-meta/index.html


My blog: https://databrickster.medium.com/