Hello,
I am new to prefect, I have a use case where I want to have a separate queue and execution environment per task in a workflow. I want to scale as per the task and give the number of workers for a specific task. I also need to control the parallelism of workflow. If anyone have done similar work or know good resources to look at, it will be of great help.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.