Adam Roderick

07/11/2019, 1:01 PM
Other question, I want to accommodate ad hoc, parameterized flow runs. In the current system, these are triggered by some agent putting a message in an SQS queue. Would you suggest a top-level flow that monitors the queue on a schedule and runs flows or tasks as messages are received? Or some non-prefect listener that will kick off the flow runs as messages are received? I'd like to have the runs be individual for later visualization and troubleshooting

Chris White

07/11/2019, 4:30 PM
So honestly, my recommendation here is going to be Prefect Cloud (feel free to e-mail me at if you’d like to explore this further and hear more about our timelines); any other approach might work in some cases, but won’t be robust against all possible edge cases
👍 1
that is to say, I don’t think I actually have a recommendation for how to create your own orchestration system for Core, there are lot of different approaches you could take