Hey Prefect community! 👋
Is there a way to control the order of mapped executions (I use local dask executor)?
I noticed that once mapped (and scheduled) the actual execution is quite random… Whereas in my case, I need to be consecutive in the order I have provided it). Any help would be much appreciated! 🙂
e
Enda Peng
05/02/2021, 4:17 PM
When you use
map
function, you already make the assumption that the task could be executed in a random order. I’d suggest you ament your flow to enforce the order of your tasks
upvote 1
k
Kevin Kho
05/02/2021, 4:45 PM
Hi @Newskooler! There is no way to do this at the moment. You may be interested in following this issue . If you need sequential dependencies, you unfortunately probably need to rearchitect for now as Enda said.
🚀 1
n
Newskooler
05/02/2021, 4:49 PM
Thank you @Enda Peng and @Kevin Kho
What would be the suggested way to re-architect it in this case?
Newskooler
05/02/2021, 4:50 PM
That’s exactly what I need. It will be cool if you implement it at some point : )
k
Kevin Kho
05/02/2021, 4:51 PM
Maybe look at this for how to set sequential dependencies in a loop. Yes please feel free to chime in on the issue.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.