Suchindra02/16/2021, 9:16 PM
My flow looks something like this:
How can I pass both the result of the previous mapped fn and also the input parameters to my transform fn? I understand that I could probably refactor the transform_fn to avoid using the
list_of_files = Parameter() list_of_frames = extract_fn.map(list_of_files) # This is indeed getting executed in parallel
but wanted to know if there is any other way of handling this.
As you can tell I am very new to prefect. Thanks a lot!
Jim Crist-Harif02/16/2021, 9:18 PM
: https://docs.prefect.io/core/concepts/mapping.html#unmapped-inputs. This lets you wrap an argument to a
call , and prefect will pass that argument in directly, rather than map over it.
Suchindra02/16/2021, 9:20 PM
Jim Crist-Harif02/16/2021, 9:22 PM
should work then.
Suchindra02/16/2021, 9:28 PM
. Will debug it
some reference tasks failed
needed to be
and the rest passed in as is