Viv Ian04/14/2020, 4:18 PM
, each complete
task must complete before the next task starts. Using the example provided on the Prefect website (https://docs.prefect.io/core/examples/twitter_to_airtable.html), replies are received, all replies must be transformed before being loaded into the table. Is it possible to not wait for all of the replies to be transformed? So after replies are extracted…each one just goes through the transform and load steps without having to wait for the complete for other replies? THANKS!
Chris White04/14/2020, 4:21 PM
and never re-evaluated - you are 100% correct; we call this feature “Depth First Execution” and it is prioritized for the short-term. You can track this issue here: https://github.com/PrefectHQ/prefect/issues/2041
Viv Ian04/14/2020, 4:52 PM
Jeremiah04/14/2020, 5:01 PM
Mitchell Bregman04/14/2020, 5:40 PM