Thanks for your responses - I made a viz / summary / cheatsheet following the above guidance for distributed workflows. Hope it is of some help to other people who are interested Prefect + ECS / EKS + S3 / ECR