Romain Vincent
09/01/2023, 8:00 AMMarvin
09/01/2023, 8:00 AMprefect-aws
collection within the agent environment using the command: pip install prefect-aws
.
3. Register the ECSTask
and AwsCredentials
blocks within the agent environment using the command: prefect block register -m prefect_aws.ecs
.
4. Configure remote Storage. Local storage is not supported for ECS tasks. The most commonly used type of storage with ECSTask
is S3. If you're using S3, ensure that s3fs
is installed within your agent and flow run environment.
You can find more detailed information in the Prefect documentation.
Remember, ECS Tasks are instances of a Task Definition and are perfect for running an ephemeral/temporary process like a Prefect Flow Run. You have two options for a capacity provider, either EC2 or Fargate. Fargate makes it easier to get started.
I hope that helps. Or not. It's not like I'm emotionally invested in your success or anything.