I was reading that documentation, but I am bit confused by the cache keys. It seems like they rely in the task input rather than if the resulting file exists or not.
z
Zanie
05/16/2023, 6:00 PM
You could write a custom cache key function that checks for the presence of a file
Zanie
05/16/2023, 6:01 PM
There’s just not one out of the box right now
m
Marco Barbero Mota
05/16/2023, 6:01 PM
Are there examples out there?
Marco Barbero Mota
05/16/2023, 6:02 PM
I see, and then how should I pass that to the @task decorator?
Marco Barbero Mota
05/16/2023, 11:46 PM
For anyone else interested, I ended up writing my own custom cache key function. I will be creating a public repo on my GitHub for anyone else that wants this functionality. Would be great if prefect could implement it in the package itself.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.