Hi prefect friends I haven t checked in in a bit Do we have

Question

Hi prefect friends I haven t checked in in a bit Do we have `Result` equivalent in prefect 2 0 slightly smiling face

Evan Curtin · Answer

Example use cases Cloud store mlflow metrics

Khuyen Tran · Answer

Do you want to add checkpoint to your task

Evan Curtin · Answer

I want to pass data from one task to the next using data storage outside of prefect

Evan Curtin · Answer

either because 1 data is far too large to handle in prefect or 2 I want it persisted outside anwyay

Evan Curtin · Answer

yeah and I d like to use the Result type to allow custom checkpointing logic i e things like checking for spark s SUCCESS file at a remote storage location

Bianca Hoch · Answer

Hey Evan just trying to brainstorm potential solutions for what you re trying to accomplish here Have you considered using to utilize external to Prefect We have one which can be used for

Evan Curtin · Answer

I basically want what already exists in 1 0 <https docs v1 prefect io core concepts results html pipeline persisted result objects>

Evan Curtin · Answer

I ve been quite confused in 2 0 as to how I m supposed to be passing data around between tasks Am I expected to pass around URI s and have each task do I O

Bianca Hoch · Answer

Thank you for clarifying We will have an equivalent for 1 0 Results in 2 0 in the near future This is a high priority feature and will make a debut this quarter