Can concurrency tagging be used with resource_managers? We are creating an RDS instance as a @resource_manager and due to AWS limits there can only be 10 running at a time. The resource is used across several tasks so I don't think tagging the tasks would work. Is there another way to limit concurrency to avoid creating more than 10 of the resources protected by @resource_manager at a time?
k
Kevin Kho
04/10/2021, 2:48 PM
Hi @Trevor Kramer! Unfortunately, it can’t be used with resource_managers. I think you have you tag tasks that use that resource.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.