04/27/2020, 2:05 AM
Q: is there a way to cache output persistently?
nicholas pointed me to caching here
(thanks!) but it seems the doc implies it’s in memory only -
seems to confirm
OTOH nicholas did mention if we use server (we are using self-hosted) we can use that to persist the cache
Laura Lorenz (she/her)
04/27/2020, 1:19 PM
! Yes, tl;dr if you are using server the cache can be retrieved from result handlers (here’s a page about configuring result handlers:
) That being said, there are some changes in flight on the topic, a bit of a long explanation incoming…. We are working on providing a caching mechanism that more transparently goes off of persistence called `target`s (similar to Makefile or Luigi targets). The design document is here:
and the latest branch where we are working on it is here:
. You may be interested in a prior discussion about cache persistence specifically here too on the same vein:
(update: I see that’s the issue you referred to, so you know! 🙂 ) Sorry for all the links 🙂 but hopefully that gives some extra context!
04/27/2020, 1:56 PM
@Laura Lorenz (she/her)
Thanks for those links, will take a deeper dive!