parameter is required on the deploy method? My understanding is a process work-pool simply launches flow runs as sub-processes and therefore shouldn't require a Docker image.
j
Jenny
11/01/2023, 2:40 PM
Hello and thanks for the question! If you're using a process worker, it might make more sense to use the
flow.serve
method!
Jenny
11/01/2023, 2:42 PM
Or we recommend this guide for getting started hosting a served flow.
a
Aj Floersch
11/01/2023, 2:45 PM
Gotcha! I will take a look at that guide. For my scenario, I want to leverage the features of a work-pool, such as concurrency limits and queue configuration, but don't want every flow to be executed inside its own container like a lot of the examples I've seen.
Aj Floersch
11/01/2023, 2:46 PM
If I understand the
.serve()
method correctly, the benefits of the work-pool is lost. Which I assume is why the
process
work-pool type was added?
j
Jenny
11/01/2023, 3:04 PM
Thanks for the feedback on this. We're actively working on deployment and work pool UX so I'll flag your message to the team.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.