Aram Panasenco
03/03/2022, 6:16 PMKevin Kho
03/03/2022, 6:17 PMAram Panasenco
03/03/2022, 6:19 PMKevin Kho
03/03/2022, 6:25 PMwith Flow(...) as flow:
tasks = []
for i in range(10):
x = task_a(input1[i], input2[i])
tasks.append(x)
for i in range(1,10):
tasks[i].set_upstream(tasks[i-1])
or you can use the KV Store to persist the state of the loop and fetch it so you can restart from where you left offAram Panasenco
03/03/2022, 6:35 PMKevin Kho
03/03/2022, 6:48 PMAram Panasenco
03/03/2022, 6:51 PMKevin Kho
03/03/2022, 6:53 PMprefect.context.get("parameters")
and then raise the condition for sure. Uhhh…I hope not too much but those are still API calls to update the state haha so maybe 1 second each hopefully?Aram Panasenco
03/03/2022, 6:59 PMKevin Kho
03/03/2022, 7:10 PMAram Panasenco
03/03/2022, 7:21 PMKevin Kho
03/03/2022, 7:22 PMAram Panasenco
03/03/2022, 7:26 PMKevin Kho
03/03/2022, 7:26 PMAram Panasenco
03/03/2022, 7:48 PM