Josh Paulin
10/14/2022, 5:16 PMtask_input_hash
as the cache_key_fn
?
On step 3 I’m seeing the flow fail that it can’t find the cache file…Christopher Boyd
10/14/2022, 5:25 PMJosh Paulin
10/14/2022, 5:26 PMChristopher Boyd
10/14/2022, 5:28 PMWhen each task run requested to enter a Running state, it provided its cache key computed from the cache_key_fn. The Orion backend identified that there was a COMPLETED state associated with this key and instructed the run to immediately enter the same COMPLETED state, including the same return values.
Task results are cached in memory during a flow run and persisted to the location specified by the PREFECT_LOCAL_STORAGE_PATH setting. As a result, task caching between flow runs is currently limited to flow runs with access to that local storage path.
Josh Paulin
10/14/2022, 5:34 PMChristopher Boyd
10/14/2022, 6:04 PMJosh Paulin
10/14/2022, 6:18 PMChristopher Boyd
10/14/2022, 6:26 PMJosh Paulin
10/14/2022, 7:05 PMChristopher Boyd
10/14/2022, 7:08 PMJosh Paulin
10/17/2022, 1:14 PMChristopher Boyd
10/17/2022, 1:54 PMJosh Paulin
10/17/2022, 1:56 PMChristopher Boyd
10/17/2022, 2:24 PMJosh Paulin
10/17/2022, 2:32 PM