I have a daily flow "daily_exporter" (which exports data from another system) in the morning at e.g. 6:00am. Beginning at 7:00am there are many other scheduled flows relying on the exported data of "daily_exporter". They all check if the exported data file is available, retry for a while, and if the export is not available after several retries they are configured to fail. Unfortunately, sometimes the initial "daily_exporter" fails (due to low memory or whatever reason). This means I have many failed flows at 09:00am. To resolve the situation it seems, that I have to manually go through each flow run in the UI and restart each failed flow individually. This manual process is very time-consuming and annoying. Does anyone has any practical hint to improve this? Is there any way to just click on a single button to restart ALL failed flows?
k
Kevin Kho
08/30/2021, 2:23 PM
Hey @Fabian, I think the easiest way to do this would be using the graphQL API. You can restart a flow by changing the state from Failed to Scheduled. I think you would want to filter though as restarting all would potentially restart flows you don’t want?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.