Hi Prefect Team, first a thank you to the wonderful job you have done creating this platform! I have a question about heterogeneous flow run: 1. Is there any way for a user to create a flow that runs on different type of hardware in the queue? I need to create a flow that partially run on CPU kubernetes queue and partially on GPU enabled nodes. There doesn't seem to be a way to do this and each flow can only run on pure CPU or all with GPU. 2. If not, what's the best practice for doing this? Should I break a flow into separate subflows and deploy them separately and run each step by hand? Or can I trigger this automatically by having a task run other deployed flow in a different queue. 3. Is there any plan to add per task tagging system for agents so when an agent pulls from a queue it only pulls tasks with a certain tag

I approach this by deploying different flows and compose them in a meta-flow. https://docs.prefect.io/concepts/flows/#composing-flows

Doesn't the metaflow need to be submitted to an agent queue as well? Also the doc page doesn't contain any information about metaflow

Sorry, in my mind meta-flow is the flow calling the other flows. But the meta-flow itself is also just a normal flow. And you are right, it needs to run via an agent as well.

So it still can't be used in different hardware environment.

Ah, thanks for taking the time to answer this. I think this is the solution of using a flow to trigger another flow

I am currently stuck on a very similar problem, where I want to submit the same flow multiple times from a meta-flow. Let me know when you figured it out.

can you not just have two deployments that have different nodeSelector/Affinity rules to target the relevant node

@redsquare Yes, but still you need to run one flow on a singular node type.