https://prefect.io logo
#prefect-community
Title
# prefect-community
n

Nico Aiello

02/26/2020, 9:14 PM
Hey everyone, I'm new to the prefect community and was hoping to get advice on how to use prefect for my particular use case. Suppose we first have some batcher task that takes a set of items and batches them into groups. We then need a task to run on each batch. (So far, this can be handled using prefect's mapping). Next, we then want to run a task for each item in the batch and we'd like to be able to run this as soon as each batch finishes, rather than waiting for all batches to finish. To visualize a simpler version: