I am getting this warning and I don't understand what it means - UserWarning: Task <Task: pack_ds_data> has retry settings but some upstream dependencies do not have result types.
c
Chris White
04/30/2021, 1:35 AM
Hi Trevor - this warning is letting you know that an upstream dependency of your
pack_ds_data
task is not configured to persist / checkpoint its output anywhere. This means that if your
pack_ds_data
task needs to retry, and for some reason it ends up retrying in a new process, it will not have access to the inputs that were provided. In practice this is rare, but it could occur (hence the warning)
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
