Is there a way to use flowrunner on a schedule? I would like to return only the last task instead of all task, but return_task is only available in the flowrunner and not in flow.run 😞
c
Chris White
04/29/2020, 7:36 AM
Could you explain your use case for this? When using
flow.run()
, ultimately all task results will be held in memory at the end of the run, regardless of which ones you want to return
a
alvin goh
04/29/2020, 9:03 AM
I noticed that at the end of my flow, there is a long pause of 5-10 seconds between the last task success and the final flow success message., using DaskExecutor(local_processes=True).
I thought it might be because the results are being sent back to the main thread to be collected into the state object, thus the delay..