from storage - if you don't explicitly attach it, Prefect uses local storage and attaches the hostname as a label so that related flow runs will only be picked up by agents that can access this local file
I would recommend attaching S3 storage when using ECSRun - if you need some examples, check out those that have S3 and ECS names in them here
I remember. This only reinforces my recommendation to switch to S3 storage though 🙂
04/25/2022, 8:01 PM
Yes prefect will push the Flow to S3 for you and that shouldn’t have the default label.
If you use local storage with ECSRun to point to the file inside the container, you can do:
Not sure whether relying on env variables for that is a good approach. You mentioned you need some pointers - this Discourse topic is dedicated to this problem in its entirety.
specifically, this code snippet may help build such logic via a simple function