https://prefect.io logo
Title
h

Haotian Li

02/08/2023, 4:19 PM
Reposting here for some discussion: Hi Prefect Team, first a thank you to the wonderful job you have done creating this platform! I have a question about heterogeneous flow run: 1. Is there any way for a user to create a flow that runs on different type of hardware in the queue? I need to create a flow that partially run on CPU kubernetes queue and partially on GPU enabled nodes. There doesn't seem to be a way to do this and each flow can only run on pure CPU or all with GPU. 2. If not, what's the best practice for doing this? Should I break a flow into separate subflows and deploy them separately and run each step by hand? Or can I trigger this automatically by having a task run other deployed flow in a different queue. 3. Is there any plan to add per task tagging system for agents so when an agent pulls from a queue it only pulls tasks with a certain tag
1
g

George Coyne

02/08/2023, 7:20 PM
Hey Haotian 1. This pattern is something we call dependent deployments. Use the run_deployment utility function to trigger downstream deployments running on disparate infra 2. Yep it's a subflow type pattern 3. No, this would be all be flow level
h

Haotian Li

02/09/2023, 5:54 AM
Thanks @George Coyne! If I understand correctly, the way is to create at-hoc deployment at runtime in a node to offload the gpu flow in another deployment? Is there an example of this?
@Tim-Oliver Maybe this can help
🙏 1
g

George Coyne

02/09/2023, 2:19 PM
I would not create an adhoc deployment, I would create two deployments and trigger the downstream one
h

Haotian Li

02/10/2023, 7:26 AM
This is great, I think it solved our problem with deployment calling
1