Hello to all! I have a question. Using checkpoints and targets, I set up the pipeline in such a way that successfully completed tasks are not re-executed. It’s great! But is there any mechanism that allows you to force the task to be reloaded? For example, when you need to force overwrite a file, even if it has already been created.
k
Kevin Kho
02/09/2022, 6:30 PM
Hi @Vladislav Bogucharov, you can check the docs on caching here because cache takes in a
cache_validator
so you can override the cache like that instead of target which is file based
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.