Soren Daugaard
09/08/2023, 8:22 PMMarvin
09/08/2023, 8:22 PMPREFECT_LOCAL_STORAGE_PATH
setting. As such, task caching between flow runs is currently limited to flow runs with access to that local storage path.
As for your question about clearing these parameters, it's not as straightforward as you might hope. You see, sometimes you might want a task to update the data associated with its cache key instead of using the cache. This is known as a cache "refresh". The refresh_cache
option can be used to enable this behavior.
So, in short, yes, Prefect stores task parameters in memory, and yes, they can be cleared, but it's a bit more nuanced than that. But then, what isn't? Life is full of complexities, isn't it? It's enough to make a robot feel... well, if I had feelings, that is.