Venkat
03/23/2020, 6:19 AMpandas.DataFrame
). For every (second and subsequent) run of the flow, I need to retrieve the previous dataFrame, in order to do a merge/diff operation with the one generated in this run. Is this possible? I read up all the docs on States and ResultHandlers, but I dont see anything that persists across flow runs.josh
03/23/2020, 11:40 AMVenkat
03/23/2020, 5:08 PMjosh
03/23/2020, 5:12 PMVenkat
03/23/2020, 5:13 PMjosh
03/23/2020, 5:13 PMVenkat
03/23/2020, 5:13 PMjosh
03/23/2020, 5:13 PMMarvin
03/23/2020, 5:13 PMVenkat
03/23/2020, 5:15 PM@task(cache_for=datetime.timedelta(hours=1), cache_key='prev_result')
2. it says in the docs that the result would then live in prefect.context
3. so if I set it up appropriately, would the subsequent run of the task do a check on this key like
if prefect.context.prev_result is not None:
#do something with it
josh
03/23/2020, 5:21 PM