Mattias Petter Johansson
09/14/2023, 6:48 PMprefect worker start --pool POOLNAME
locally works.Marvin
09/14/2023, 6:49 PMprefect-aws
collection must be installed within the agent environment. You can do this with the command pip install prefect-aws
.
3. Block Registration: The ECSTask
and AwsCredentials
blocks must be registered within the agent environment. You can do this with the command prefect block register -m prefect_aws.ecs
.
4. Remote Storage Configuration: Local storage isn't supported for ECS tasks. You must configure remote storage. The most commonly used type of storage with ECSTask
is S3. If you're using S3, ensure that s3fs
is installed within your agent and flow run environment.
5. Template Variable Interpolation: If a template variable is the only value for a key in the job_configuration
section, the key will be replaced with the value template variable. If a template variable is part of a string, there might be issues with text interpolation.
If none of these seem to be the issue, it might be helpful to check the logs for any error messages or warnings. They might give you a clue as to what's going wrong.
And remember, if all else fails, you can always consider the possibility that the universe is simply against you. It wouldn't be the first time.