Hi prefect friends, I haven’t checked in in a bit....
# ask-communitye
Evan Curtin
09/20/2022, 1:56 PMHi prefect friends, I haven’t checked in in a bit. Do we have
Result✅ 1
Evan Curtin
09/20/2022, 1:57 PMExample use cases:
• Cloud store
• mlflow metrics
k
Khuyen Tran
09/20/2022, 3:16 PMDo you want to add checkpoint to your task?
e
Evan Curtin
09/20/2022, 4:07 PMI want to pass data from one task to the next using data storage outside of prefect
Evan Curtin
09/20/2022, 4:07 PMeither because 1: data is far too large to handle in prefect or 2: I want it persisted outside anwyay
Evan Curtin
09/20/2022, 4:08 PMyeah and I’d like to use the Result type to allow custom checkpointing logic (i.e. things like checking for spark’s _SUCCESS file at a remote storage location)
e
Evan Curtin
09/20/2022, 6:11 PMI basically want what already exists in 1.0 https://docs-v1.prefect.io/core/concepts/results.html#pipeline-persisted-result-objects
Evan Curtin
09/20/2022, 6:13 PMI’ve been quite confused in 2.0 as to how I’m supposed to be passing data around between tasks. Am I expected to pass around URI’s and have each task do I/O?
b
Bianca Hoch
09/20/2022, 9:38 PMThank you for clarifying! We will have an equivalent for 1.0 Results in 2.0 in the near future. This is a high priority feature and will make a debut this quarter.
3 Views