Is there a way for to override the

target

keyword argument for all tasks at flow level? I have some tasks with

target

caching and for testing I would like all the result files to be created again without caching. If we can selectively decide which one to override for a particular run that would be even better

@An Hoang target is a file-based persistence, which means that as long as you remove those files (or when you move those files to a different directory), the caching will be effectively disabled without having to specify anything on a flow-level. You can also selectively decide which ones you remove - those that were removed from the target directory will be recreated at runtime and for those that still exist Prefect will use them as file-based “caching” without rerunning the task.

Thanks. I have been doing that while debugging and find having to delete selective files cumbersome. Is there a setting or "debug" mode at run level to disable some of those file-based persistence ?

I understand the sentiment, but I can’t quite envision what an elegant interface for this would be. You can currently turn off checkpointing completely, but you want to checkpoint some tasks. I think even if an interface was exposed you’d still have a bunch of configuration to do for task-specific checkpointing. I think for you specific use case you can do:

@task(checkpoint=True, target="...")
def abc(x):
    return x+1

def make_flow():
    with Flow(...) as flow:
        return flow

if debug:
   abc.checkpoint=False
   abc.target=None
   flow = make_flow()
   flow.run()
else:
   flow = make_flow()
   flow.register(...)