Automatic Data Lineage without Unity Catalog

[ty090]

Hi there,

Is there any way to have an automatic Data Lineage without the usage of Unity Catalog, instead utilizing legacy Hive?

My limited research shows there is no such option, at least without using some external tools which is not really an option for me, but I hope to be proven wrong.

Thanks for your time.

[szymon_dybczak · Accepted solution]

Hi @ty090 ,

I don't think that's possible with Hive metastore. If you need lineage then your best option is to migrate to Unity Catalog.

[ty090]

I thought so, thank you for your confirmation

[sridharplv]

Hi @ty090 , you need to build a lineage generation tool if you have specific requirement of not using unity catalog or beyond databricks.