Hello. I’m using DaskExecutor using FargateCluster and ECS Agent (Prefect 1.2.0).
I found ECS Task executed by Agent call DescribeTasks API to dask scheduler so many times, thus throttling error occurs in other services.
Is there any ways to reduce API call?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.