Hi all,
A couple of questions:
1. Anyone could po...
# prefect-communitym
Marco Barbero Mota
05/16/2023, 5:56 PMHi all,
A couple of questions:
1. Anyone could point me to what is the functionality in prefect 2.0 that does the same as
@task(LocalResult(dir='path/to/folder/for/storage),target='result.pkl',checkpoint=True)result.pkl✅ 1
s
Stéphan Taljaard
05/16/2023, 5:58 PMHi. I believe you're asking about this https://docs.prefect.io/latest/concepts/results/?h=results#persisting-results?
🙌 1
m
Marco Barbero Mota
05/16/2023, 6:00 PMI was reading that documentation, but I am bit confused by the cache keys. It seems like they rely in the task input rather than if the resulting file exists or not.
z
Zanie
05/16/2023, 6:00 PM
You could write a custom cache key function that checks for the presence of a file
Zanie
05/16/2023, 6:01 PM
There’s just not one out of the box right now
m
Marco Barbero Mota
05/16/2023, 6:01 PMAre there examples out there?
Marco Barbero Mota
05/16/2023, 6:02 PMI see, and then how should I pass that to the @task decorator?
Marco Barbero Mota
05/16/2023, 11:46 PMFor anyone else interested, I ended up writing my own custom cache key function. I will be creating a public repo on my GitHub for anyone else that wants this functionality. Would be great if prefect could implement it in the package itself.
🙌 2