Matthew Roeschke
04/28/2022, 10:21 PMmap
. I added max_retries
to this task I got this Userwarning I don’t really know how to addressed based on the link. I thought I could pass the results from a functional task to another task?
UserWarning: Task <...> has retry settings but some upstream dependencies do not have result types. See <https://docs.prefect.io/core/concepts/results.html> for more details.
Anna Geller
from prefect import Flow, task
from prefect.engine.results import PrefectResult
@task(result=PrefectResult())
def my_task():
return 3
>>> state.result[first_result]._result.value
3
>>> state.result[first_result]._result.location
'3'
Here is explanation from the docs:
"For example, suppose task A is configured to use result A, and task B to use result B, and that A passes data downstream to B. If B fails and requests a retry, it needs to cache its inputs, one of which came from A. If you are using Cloud, Cloud will use results to persist the input cache, and since the data is from task A it will use the result configured on A."Anna Geller
@task(checkpoint=False) # to disable
Matthew Roeschke
04/29/2022, 1:08 AMBring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by