Quick question, we usually achieve caching by using the checkpoint i.e. result are stored on the file.
At times one of our task might fail and it might be possibly due to one of the upstream task had some issue and wanted to know if there is a way to remove the cache from the UI rather than going to backend and remove the file manually.
k
Kevin Kho
11/18/2021, 8:24 PM
Hey @Vipul, you can’t from the UI. I think what you are requesting is that if you have tasks A-> B -> C and then A and B succeed but C fails, a restart would only trigger C but you want to restart A and B too in some cases. We don’t have a way in current Prefect, but this will be a first class feature in Orion (Prefect 2.0)
v
Vipul
11/18/2021, 8:26 PM
Thanks @Kevin Kho to come back quickly, so are you saying this is possible to do in Prefect Orion
k
Kevin Kho
11/18/2021, 8:28 PM
Yes it will be for sure
v
Vipul
11/18/2021, 8:29 PM
nice and would this allow me to even remove the result cache file or am I getting too greedy with Orion
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.