I think Prefect currently lacks an organized way to quiesce agents in preparation for an upgrade. i.e. I want a way to tell agents “finish what you’re doing but don’t accept any new work” so I can shut them down and replace them in an organized manner without interrupting any flows.
Should I file an issue about this, or is there an accepted workflow for accomplishing this?
k
Kevin Kho
08/31/2021, 3:59 PM
Hey @Nicholas Chammas, if you are using anything other can a local agent, the work will continue and new flows will just be queued until there is another agent. If you have labels, maybe you can remove them too?
n
Nicholas Chammas
08/31/2021, 4:05 PM
So if I tear down an agent while it’s running flows and later spin up a replacement, the replacement will automatically continue those interrupted flows?
k
Kevin Kho
08/31/2021, 4:11 PM
No the flows spun up by Docker, Kubernetes and ECS agent will continue to run. The replacement will pick up the new flows that were queued.
Kevin Kho
08/31/2021, 4:27 PM
Just learned that you can also pause all scheduled runs by going on the dashboard upcoming runs tile > options