Hello there ! Is there any clean way to have a different executor configuration for some tasks of a given Flow ? The use case is that we have flows with a few tasks being very resources-hungry and we would like to reduce our overall resources consumption by running those hungry tasks on bigger nodes than the other tasks. I suspect it might not be possible out of the box and require us to split tasks into different flows and then using a flow of flows but it does not sound good. We are using a KubernetesRun with a DaskExecutor spawning a dask cluster on our k8s. Thanks !

@Sylvain Hazard you are 100% correct that separating those tasks into individual flows would be the right way to approach it. Since executors are assigned to flows, not to tasks, you could have a flow of flows with a different executor on each child flow.

It's mostly the readability in the UI that concernes me a bit. I really enjoy using the schematic to see how flows went and flows of flows are a bit less clear on that in my opinion. Also it would require me to create kind of "abstract" flows that don't do anything by themselves and need to be included in another flow. Maybe putting them in a separate project would be best actually. Mostly it would be a major refactor of our project and I hoped there was an easier way 😅

Got it. There is no easier way. The entire subflows story will be easier to reason about In Orion

Yet another reason to be hyped about Orion ! Thanks again for your time 🙂