Hey folks :simple_smile: We are using ECS Agent to execute flows. Is there a way to apply custom tag...

ale

12/20/2021, 9:47 AM

Hey folks simple smile We are using ECS Agent to execute flows. Is there a way to apply custom tags to the ECS task that is executed?

Anna Geller

12/20/2021, 10:16 AM

@ale do you need that for billing purposes? In general, you can add tags to your cluster to which you deploy your ECS agent and all the ECS tasks for your flows deployed to that cluster would inherit those tags.

Copy code

aws ecs create-cluster --cluster-name prefectEcsCluster --tags key=team,value=devs

You can find more details here

ale

12/20/2021, 10:28 AM

Thanks Anna! 🙌

ale

12/20/2021, 10:28 AM

cc @Giacomo Consonni @grandimk

ale

12/20/2021, 10:44 AM

Well, we do have the right tags on the cluster. But for some unknown reason, they are not applied to tasks running on the cluster 😅

ale

12/20/2021, 10:48 AM

We might need to enable tag propagation

ale

12/20/2021, 10:48 AM

We’ll investigate

Anna Geller

12/20/2021, 10:51 AM

Correct, this flag seems to be relevant: --propagateTags Keep us posted, it’s an interesting topic. I think in the worst case, maybe you could track the costs just via the ECS cluster provided that all flows are deployed to the same cluster and only to that cluster.

👍 1

ale

12/23/2021, 9:53 AM

Hey @Anna Geller 👋 I confirm that using

propagateTags

did the trick! We used this config:

Copy code

enableECSManagedTags: true
propagateTags: TASK_DEFINITION

Anna Geller

12/23/2021, 10:57 AM

Nice work and thanks for sharing!

5 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.