Hi community 🙂
I’m wondering the best way to handle a long running flow with several tasks having different resource requirement, without wasting too many resources.
For instance a flow with 2 tasks that are both quite long: the first task needs many GBs of memory and the second one just a few MBs.
Using the k8s agent/executor, prefect is creating a single pod that run the entire flow, so I need to requests the GBs of memory for the whole flow 😕 while it’s needed only for the first task.