Model Lineage to Downstream Element

[FedeRaimondi]

Hello,

I tried to search for the topic in the community but couldn't find much around downstream lineage element that can be connected to a Unity Model.

As far as I understood, if I have an inference workflow that loads a model from unity catalog and then writes the inference on a unity catalog table that won't be visible in the model downstream lineage assets.

The workflow in my case is correctly visible and inside the workflow I see the downstream inference table. If this is not doable today, it would be a great addition to the platform to have a complete lineage (and lineage charts).

[Vinay_M_R · Accepted solution]

Hello @FedeRaimondi, 

Downstream lineage: clear visibility from the model to the inference tables created by jobs or workflows consuming the model—is not supported currently in the same way as upstream lineage. I checked regarding this internally and found there is expressed future goal to also make downstream (e.g., batch inference jobs, serving endpoints, and their outputs) visible as part of model lineage.

As of now, downstream lineage—making inference tables directly visible as downstream assets from the model object is not supported.

This is a known limitation, and improving downstream lineage (showing inference tables/output directly in the model’s lineage) is on the product’s long-term roadmap/future considerations, but currently it is not available.

Concluding your suggestion for end-to-end lineage is recognized as valuable and is already being discussed internally.