KhTan
12/15/2021, 11:10 PMdef pipe(dt):
#get intermediary output
output1, output2, output3 = step1(dt)
#write to database
step2(output1, output2, output3)
is it like this or is there a better way?
with Flow('multi-output func') as flow:
dt = Parameter("urls", default=['dt1', 'dt2', 'dt3'])
for dt in dt_range:
pipe(dt)
thank youKevin Kho
List[Tuple]
while using it for mapping requires a structure like Tuple[List]
so you need to reshape the outputs with an intermediate taskKhTan
12/16/2021, 4:45 PMKevin Kho