https://prefect.io logo
a

Abin Joseph

07/11/2022, 11:30 AM
Hi all, is it possible to have different executors per step? This is useful when resource requirements are different for steps
1
a

Anna Geller

07/11/2022, 11:32 AM
you would need to use the orchestrator pattern to accomplish that in 1.0: https://discourse.prefect.io/tag/orchestrator-pattern in 2.0, you can set different task runners per subflow
a

Abin Joseph

07/11/2022, 11:48 AM
@Anna Geller Don't you lose the benefits of prefect (compared to something like airflow) with this pattern?
a

Anna Geller

07/11/2022, 11:50 AM
why do you think so? generally, this is much easier handled in Prefect 2.0 which comes out of beta this summer, perhaps you could postpone implementing this pattern until you switch over to Prefect 2.0?
a

Abin Joseph

07/11/2022, 2:20 PM
Even flow simple steps you've to create seperate flows for it. Isn't that unnecessary?
a

Anna Geller

07/11/2022, 7:37 PM
I didn't understand, can you explain a bit more?
3 Views