Hello everyone! Does anyone have a recommendation for a Data Catalog tool that would be compatible with Prefect? I haven't been able to find one that would integrate with Prefect but would like to be able to see data lineage from the different elements in our data stack.
k
Kevin Kho
06/17/2021, 3:57 PM
Hey @Jonathan Pou, we don’t have any tasks in task library. We accept contributions though. We’d love to hear more about how you think this feature would look like. At the moment, you can achieve this somewhat by using the Artifacts. You would need to shape your metadata output to pass to the Data Catalog, whichever one you choose.
z
Zach Schumacher
06/17/2021, 4:00 PM
this is going to a cool project when it comes to fruition, company started by the guys from LinkedIn who started DataHub https://metaphor.io
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.