https://prefect.io logo
Title
m

Mars

04/27/2022, 8:47 PM
Hi all, what would you consider best practice for reporting business-case-specific results from a Prefect pipeline, such as a data cleansing task or data quality checkpoint task? Would you report the results directly to the prefect logs, or is it better to keep the prefect logging to task summaries and output detailed reports as a text or html file?
k

Kevin Kho

04/27/2022, 8:47 PM
Are you familiar with Prefect Artifacts?
Or just persist it somewhere and then make a link artifact to point to it?
m

Mars

04/27/2022, 9:01 PM
oh wow, Artifacts sound really powerful. thanks!
k

Kevin Kho

04/27/2022, 9:07 PM
But they are not permanent. They are attached to the Flow Run so they are affected by retention limits
m

Mars

04/27/2022, 9:25 PM
so it would make sense to post them to both the UI and to some longer-term storage if you need them then
k

Kevin Kho

04/27/2022, 9:26 PM
Yeah anyway if you use a link artifact, it presumably lives in that other location.