Josh Pitts
01/10/2021, 2:30 AMPREFECT__FLOWS__CHECKPOINTING=true
, what is actually happening regarding target
, checkpoint=True
, and result=LocalTarget()
? or are those just ignored?Jackson Maxfield Brown
01/10/2021, 3:16 AMtarget
uses checkpointing, so if a result already exists at that filepath, the task will be skipped and the data will only be read when needed downstream. If you replace target
with location
it will always be overwritten each run.Josh Pitts
01/10/2021, 3:21 AMtarget
with location
but i am getting an error. I don’t see location
as a part of the Task API (https://docs.prefect.io/api/latest/core/task.html#task-2)Jackson Maxfield Brown
01/10/2021, 3:22 AMResult
APItarget
on the task but add location
to the result paramsJosh Pitts
01/10/2021, 3:26 AM