Hello everyone,
Just a quick question, whats the difference between a ECS Worker and a ECS Worker (Push)? As far as I understand reading the docs, the non-push needs a Worker running somewhere to be able to create the ECS tasks while the push one dont need that worker? Is that right?
j
Jake Kaplan
07/22/2024, 12:29 PM
hey! We support two modes of delivery of flow runs from Prefect Cloud to your ECS infrastructure:
• Worker - you run a worker in your cloud, that polls for new work and then deploys to ECS
• Push Pool - you store credentials with Prefect Cloud, and we push work directly to ECS
n
Nacho
07/22/2024, 2:28 PM
Makes sense! Thank you for your answer. As a follow-up, if I want to run 3 different flows at the same time, do I need three ECS workers or one ECS worker would be enough to deploy the ECS tasks for all the 3 flows?
Nacho
07/22/2024, 2:29 PM
I am trying to understand how serverless can I go without using Prefect Cloud (which is a pretty cool service btw, its been used by my 2 former employers)
j
Jake Kaplan
07/22/2024, 2:38 PM
The worker is asynchronous and can deploy multiple runs simultaneously, one would definitely be enough
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.