Владислав Богучаров

02/21/2022, 7:39 PM
Hello! I'm looking for a mechanism that would allow me not to restart a successfully completed task. For example, my result is stored in s3 and I don't need to overwrite it. Something like Luigi, where before executing the task checks whether such an output already exists or not. I understand that there is a cache_for and a cache_validator, but as I understand it, they are based on time, and I need a constantly reliable mechanism. Or should I implement this for myself?

Anna Geller

02/21/2022, 7:58 PM
Targets is what you need 🙂

Владислав Богучаров

02/21/2022, 8:03 PM
Works like a charm! I have to think that targets work only with local files and you cannot use both target and result. Thank you, Anna :)
👍 1