https://prefect.io logo
s

Sebastian

01/19/2020, 11:55 PM
Bumping my previous question, I was wondering if this would be a good example for flow concurrency (simulating a streaming ETL pipeline)?
c

Chris White

01/20/2020, 12:13 AM
Hi @Sebastian - apologies for missing your question earlier; for managing / orchestrating multiple flows we generally recommend checking out our free Prefect Scheduler service which uses an agent-based model for running flows concurrently. That being said, using a thread pool or a process pool should definitely work!