Viv Ian
04/14/2020, 4:18 PMmap
, each complete map
task must complete before the next task starts. Using the example provided on the Prefect website (https://docs.prefect.io/core/examples/twitter_to_airtable.html), replies are received, all replies must be transformed before being loaded into the table. Is it possible to not wait for all of the replies to be transformed? So after replies are extracted…each one just goes through the transform and load steps without having to wait for the complete for other replies?
THANKS!Chris White
04/14/2020, 4:21 PMcloudpickle
and never re-evaluated
- you are 100% correct; we call this feature “Depth First Execution” and it is prioritized for the short-term. You can track this issue here: https://github.com/PrefectHQ/prefect/issues/2041Viv Ian
04/14/2020, 4:52 PMJeremiah
04/14/2020, 5:01 PMMitchell Bregman
04/14/2020, 5:40 PM