Hi, another question about steps. We'd like one ta...
# best-practices
y
Hi, another question about steps. We'd like one task to unzip folders in gcs, and another task to process each file in the folder. Can that be done where the second task fans out (multiprocess)?
k
Yes. For Prefect 1, see mapping and for Prefect 2, you can just use a for loop and call new tasks. You just need to call
.result()
on the first task to make it a Python object before you loop
y
using a for loop will do the tasks sequentially right?
k
Not quite. The default TaskRunner is ConcurrentTaskRunner so if they are independent, they will run concurrrently
y
oh cool!