Ziyao Wei

04/27/2020, 2:05 AM
Q: is there a way to cache output persistently?
nicholas pointed me to caching here (thanks!) but it seems the doc implies it’s in memory only - seems to confirm
OTOH nicholas did mention if we use server (we are using self-hosted) we can use that to persist the cache

Laura Lorenz (she/her)

04/27/2020, 1:19 PM
Hi @Ziyao Wei! Yes, tl;dr if you are using server the cache can be retrieved from result handlers (here’s a page about configuring result handlers: That being said, there are some changes in flight on the topic, a bit of a long explanation incoming…. We are working on providing a caching mechanism that more transparently goes off of persistence called `target`s (similar to Makefile or Luigi targets). The design document is here: and the latest branch where we are working on it is here: You may be interested in a prior discussion about cache persistence specifically here too on the same vein: (update: I see that’s the issue you referred to, so you know! 🙂 ) Sorry for all the links 🙂 but hopefully that gives some extra context!

Ziyao Wei

04/27/2020, 1:56 PM
@Laura Lorenz (she/her) Thanks for those links, will take a deeper dive!
👍 1