I'm looking to run flows using AWS ECS/ECR. My flow code will live entirely inside the docker images. The plan is for one "initial" flow/container to call another flow/container after completion, and do this three or so times until my ETL process is complete.
Does anyone use this sort of setup, and if so, do you use a different ECS Task Definition for each Flow/Container?
I'm fairly new to ECS, so I'm not sure if I can use multiple containers under one ECS Task Definition (the TD effectively acting as a way to give each container the credentials it needs to run) choosing just the container I want for a given flow, or if each flow/container needs its own ECS Task Definition.
Any help would be greatly appreciated!