Hi everyone! 👋
I'm considering using Redis integration to distribute result persistence across multiple pods, enabling all flows to access the stored results. However, I encountered issues when trying to set a default TTL for result caching. Based on the documentation here: https://docs.prefect.io/v3/develop/task-caching, I observed the following:
• Keys were not cleared over time, and the TTL was not applied using the
cache_expiration
argument.
• Overriding the key name with the
cache_key_fn
argument did not work.
Both features functioned as expected when using the default
WritableFilesystem
object (writing to the local file system).
Has anyone experienced this or found a solution?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.