Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi all, what would you consider best practice for reporting business-case-specific results from a Prefect pipeline, such as a data cleansing task or data quality checkpoint task?  Would you report the results directly to the prefect logs, or is it better to keep the prefect logging to task summaries and output detailed reports as a text or html file?

Are you familiar with <https://docs.prefect.io/orchestration/concepts/artifacts.html|Prefect> Artifacts?

Or just persist it somewhere and then make a link artifact to point to it?

oh wow, Artifacts sound really powerful.  thanks!

But they are not permanent. They are attached to the Flow Run so they are affected by retention limits

so it would make sense to post them to both the UI and to some longer-term storage if you need them then

Yeah anyway if you use a link artifact, it presumably lives in that other location.