https://prefect.io logo
#prefect-aws
Title
# prefect-aws
s

Samuel Hinton

01/12/2023, 2:57 AM
Hey team! We’re trying to setup some ECS based architecture that is effectively: 1. An ECS cluster which contains prefect plus a prefect aws agent 2. The above prefect instance configured with ECSTask block and aws blocks and s3 blocks (we’re new to blocks, trying to upgrade from prefect 1) using terraform (or some version of code) that will be instantiated in a gitlab build pipeline 3. The agent then runs tasks by spinning up a separate ECS. Eg for training ML models Has anyone come across (or made) some tutorials / guides that might be a good starting point for us? We’ve found https://towardsdatascience.com/prefect-aws-ecs-fargate-github-actions-make-serverless-dataflows-as-easy-as-py-f6025335effc#8d94 but its quite different (using prefect cloud and github actions)
2 Views