Databricks Community

faruk

Hi everyone,I’m currently working on a PoC to build a data dictionary in Databricks, and one of the requirements is to retrieve lineage information programmatically.I was advised that Databricks provides Unity Catalog Lineage APIs that can retrieve t...

faruk · 06-25-2026

Hi everyone,I'm currently working on implementing a data dictionary, and I'm struggling to understand what the best approach is when using a Medallion architecture in Databricks.My company is migrating its data to Databricks so that users can consume...

faruk

@ShamenParis Thank you for your elaborate answer. I know that it is undocumented and more over it doesn't really do what i want Databricks Lineage API retains lineage data indefinitely, even after the referenced column have been deleted and it make t...

faruk

@balajij8 Thank you for your advice, i definetly agree that for a production-grade data dictionnary i have to have the needed permissions.

faruk · 06-27-2026

Hi @emma_s,First of all, thank you for your detailed answer.As you mentioned, tagging every column — and in my case every field — could quickly become overwhelming.I’ve decided to implement tags only for specific use cases, as you suggested. For allo...

faruk · 06-27-2026

@JeninaAngelin7 Thank you for your answer, very instructive.

faruk · 06-27-2026

Hi , thank you for your advice very appreciate that

Databricks Community

User Stats

User Activity

Unity Catalog Lineage APIs – Are these REST APIs publicly supported?

Data Dictionary and Unity Catalog: Best Practices in a Medallion Architecture

Re: Unity Catalog Lineage APIs – Are these REST APIs publicly supported?

Re: Unity Catalog Lineage APIs – Are these REST APIs publicly supported?

Re: Data Dictionary and Unity Catalog: Best Practices in a Medallion Architecture

Re: Data Dictionary and Unity Catalog: Best Practices in a Medallion Architecture

Re: Data Dictionary and Unity Catalog: Best Practices in a Medallion Architecture