Reposting here for some discussion:
Hi Prefect Team, first a thank you to the wonderful job you have done creating this platform! I have a question about heterogeneous flow run:
1. Is there any way for a user to create a flow that runs on different type of hardware in the queue? I need to create a flow that partially run on CPU kubernetes queue and partially on GPU enabled nodes. There doesn't seem to be a way to do this and each flow can only run on pure CPU or all with GPU.
2. If not, what's the best practice for doing this? Should I break a flow into separate subflows and deploy them separately and run each step by hand? Or can I trigger this automatically by having a task run other deployed flow in a different queue.
3. Is there any plan to add per task tagging system for agents so when an agent pulls from a queue it only pulls tasks with a certain tag
✅ 1
g
George Coyne
02/08/2023, 7:20 PM
Hey Haotian
1. This pattern is something we call dependent deployments. Use the run_deployment utility function to trigger downstream deployments running on disparate infra
2. Yep it's a subflow type pattern
3. No, this would be all be flow level
h
Haotian Li
02/09/2023, 5:54 AM
Thanks @George Coyne! If I understand correctly, the way is to create at-hoc deployment at runtime in a node to offload the gpu flow in another deployment? Is there an example of this?
@Tim-Oliver Maybe this can help
🙏 1
g
George Coyne
02/09/2023, 2:19 PM
I would not create an adhoc deployment, I would create two deployments and trigger the downstream one