Hi,
Today, after using our CI/CD pipeline to push some changes to our PrefectCloud account, the information of the flow runs from earlier versions have vanished. The version numbers are right, but is like the olders never existed. Is this the intended behaviour?
This is the bash script used to log flows. For each folder under flows/, it registers all the flows it contains in the project that is named like the folder.
k
Kevin Kho
09/10/2021, 2:33 PM
Hey @Nacho Rodriguez, by information, do you mean previous flow runs?
n
Nacho Rodriguez
09/10/2021, 2:42 PM
Exactly.
All the past flow runs have disappeared.
k
Kevin Kho
09/10/2021, 2:43 PM
You should be able to go to the flow page and click a previous version and see the flow runs
Kevin Kho
09/10/2021, 2:44 PM
Just note that there is a retention period for flow runs (2 weeks for standard tier)
n
Nacho Rodriguez
09/10/2021, 3:52 PM
The old versions disappeared. And the flow runs with them. The version numbers seems ok.
Just to clarify with an example, imagine I had a flow with +300 runs in the last week. The version number was 1. I registered the flow again. Now in Prefect Cloud I only see the version 2, and the version 1 with all the flow runs related to that version number dissapeared like it never existed.
k
Kevin Kho
09/10/2021, 4:11 PM
Got it. Will report to the team
Kevin Kho
09/10/2021, 8:35 PM
So there was an issue with the history retention logic that caused it to remove runs if the version
created_by
timestamp was outside of the history retention period. This will be fixed in the next hour or so to only take out a version if all of the runs are outside the retention period.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.