Reposting here for some discussion: Hi Prefect Tea...
# ask-community
h
Reposting here for some discussion: Hi Prefect Team, first a thank you to the wonderful job you have done creating this platform! I have a question about heterogeneous flow run: 1. Is there any way for a user to create a flow that runs on different type of hardware in the queue? I need to create a flow that partially run on CPU kubernetes queue and partially on GPU enabled nodes. There doesn't seem to be a way to do this and each flow can only run on pure CPU or all with GPU. 2. If not, what's the best practice for doing this? Should I break a flow into separate subflows and deploy them separately and run each step by hand? Or can I trigger this automatically by having a task run other deployed flow in a different queue. 3. Is there any plan to add per task tagging system for agents so when an agent pulls from a queue it only pulls tasks with a certain tag
1
g
Hey Haotian 1. This pattern is something we call dependent deployments. Use the run_deployment utility function to trigger downstream deployments running on disparate infra 2. Yep it's a subflow type pattern 3. No, this would be all be flow level
h
Thanks @George Coyne! If I understand correctly, the way is to create at-hoc deployment at runtime in a node to offload the gpu flow in another deployment? Is there an example of this?
@Tim-Oliver Maybe this can help
🙏 1
g
I would not create an adhoc deployment, I would create two deployments and trigger the downstream one
h
This is great, I think it solved our problem with deployment calling
1