Joseph Loss
04/27/2021, 11:34 PMdef fnRunTask(parameter1, parameter2, parameter3 .... parameter10):
df1, df2 = fnRunSubTask(parameter3, parameter5)
dfTmp = fnRunSubTask2(df1, parameter1, parameter7, parameter9)
2. As shown above, each subfunction requires different parameters, and the number of parameters for each function can vary.
Essentially this is all headache from converting a bunch of stuff that was defined under "if name == _main_:" into a prefect setup.
I've played around with passing in one large dictionary at the start, but wanted to ask here before I continued debugging that (didn't work on tries #1-20 lol)
Also wanted to ask about the task interconnectivity, as I was a bit confused about upstream/downstream tasks since some of them are "at the same time" within the task that calls them.Kevin Kho
print_df
not be hooked up by multiple upstream tasks? This looks messy, but I think this can work.Joseph Loss
04/28/2021, 1:48 AMJoseph Loss
04/28/2021, 2:13 AMJoseph Loss
04/28/2021, 2:16 AMKevin Kho
Joseph Loss
05/03/2021, 7:14 PMKevin Kho