Databricks table lineage

Rahman823
Databricks Partner

‎11-13-2024 07:39 AM

Hi,
I wanted to know if it is possible to edit the lineage that we see in databricks, like the one shown below.

Rahman823_0-1731512283889.png

Can I edit this lineage graph, like add other ETL tools (at the start of the tables) that I have used to get data in aws and then in databricks
is it possible to edit/modify the lineage graph? 

Walter_C
Databricks Employee
Databricks Employee

‎11-13-2024 10:22 AM

As of now this is not currently possible but there is a project to release a bring your own lineage which must help you with this.

There is no ETA yet for GA but will be coming soon.

0 Kudos

chm_user_1
New Contributor II

‎12-02-2024 01:48 PM

This will be extremely beneficial. We have certain use cases where we do not leverage Spark in our pipelines and lose the lineage. I would prefer to set an extra parameter when writing a table to specify the lineage. 

0 Kudos