Hey all, I noticed that the Prefect Cloud site mentions that Data Lineage is “coming soon.” Is there any more information about how/when this is planned to be implemented? We’re already using prefect core but are evaluating various MLOps solutions and it’d be nice not to have to introduce too many new tools.

Hi John! Thanks for pointing this out — this is unfortunately a stale reference that was originally meant to encapsulate Artifacts (which are now live!) and our enterprise Audit Trail. We quickly realized that “Data Lineage” was an overloaded term for most folks and there are more dedicated data lineage solutions out there that we would rather integrate tightly with than reinvent the wheel. We will be removing this reference from the site shortly

Gotcha! Any info on what data lineage solutions will get more tight integration?

Not at this moment — that sort of decision would largely be driven by community feedback and if there was a clear popular tool that most folks were using we would look into it; up until this point, most of the folks we’ve onboarded who asked for data lineage ended up rolling custom solutions, but it’s my understanding that this is a very hot space so I’d expect there to be some worthy options now