Josh Paulin
10/14/2022, 5:16 PMtask_input_hash
as the cache_key_fn
?
On step 3 I’m seeing the flow fail that it can’t find the cache file…Christopher Boyd
10/14/2022, 5:25 PMChristopher Boyd
10/14/2022, 5:25 PMJosh Paulin
10/14/2022, 5:26 PMChristopher Boyd
10/14/2022, 5:28 PMChristopher Boyd
10/14/2022, 5:31 PMWhen each task run requested to enter a Running state, it provided its cache key computed from the cache_key_fn. The Orion backend identified that there was a COMPLETED state associated with this key and instructed the run to immediately enter the same COMPLETED state, including the same return values.
Task results are cached in memory during a flow run and persisted to the location specified by the PREFECT_LOCAL_STORAGE_PATH setting. As a result, task caching between flow runs is currently limited to flow runs with access to that local storage path.
Christopher Boyd
10/14/2022, 5:31 PMJosh Paulin
10/14/2022, 5:34 PMJosh Paulin
10/14/2022, 5:37 PMChristopher Boyd
10/14/2022, 6:04 PMChristopher Boyd
10/14/2022, 6:05 PMChristopher Boyd
10/14/2022, 6:05 PMJosh Paulin
10/14/2022, 6:18 PMChristopher Boyd
10/14/2022, 6:26 PMChristopher Boyd
10/14/2022, 6:27 PMChristopher Boyd
10/14/2022, 6:27 PMJosh Paulin
10/14/2022, 7:05 PMChristopher Boyd
10/14/2022, 7:08 PMChristopher Boyd
10/14/2022, 7:09 PMJosh Paulin
10/17/2022, 1:14 PMChristopher Boyd
10/17/2022, 1:54 PMJosh Paulin
10/17/2022, 1:56 PMChristopher Boyd
10/17/2022, 2:24 PMChristopher Boyd
10/17/2022, 2:25 PMJosh Paulin
10/17/2022, 2:32 PM