Hey all, sometimes prefect seems to just go crazy and things stop working. Is there a way to tell prefect to “refresh, cancel all tasks that are running or pending”. I’ve tried restarting the services but it doesnt seem to change things. Screenshot of my run history below. Interesting that 52% of 561 flow runs failed, and that 52% of 561 = 12 failed flows. Essentially things seem fubar and I dont know how to make it go back to normal! Some of the runs have been going for hours too, despite every flow having a timeout of five minutes, but the timeouts not being respected has been an issue Ive known about in prefect since we first implemented it.

Hey @Samuel Hinton , check this . There is a cancel all button. Screenshots are in the thread where to find it.

Ah, is the cancel all button brand new? I dont see it on my dashboard

Within the last month or two I think.

Ill see if I can upgrade prefect then. Do you have a link to your internal docker-compose on github so I can check to see what has changed and port anything over?

There is not quite anything like that I can link you to unfortunately. Let me. I can try figuring out what specific version of the UI this happened in, if you want to know that?

Its all good, I’ve already updated the images but now cannot connect to the UI service as its reporting

/start_server.sh: line 11: syntax error: unexpected end of file

There was a bug with the latest image for the

start_server.sh

. You need to pull the UI image with tag 2021-07-13

Ah I pulled 0.15.3, not latest, but Ill swap to that tag and report backj

You mean this for the docker-compose.yml ?

Unfortunately not, there was a complete version that included towel, apollo, hasura, ui, to which I added an agent and dask workers for a fully functioning swarm

This one has a complete one I think you can use?

Yeah, ours is similar to that, just wanted to check an official version to see if anything has changed. I worry about a new service appearing, or env variables appearing that I dont have

I refer to this one when setting up my deployments https://github.com/PrefectHQ/prefect/blob/master/src/prefect/cli/docker-compose.yml

Ah beautiful, hidden under the cli, thanks mate!