Matthias
07/17/2020, 9:44 AMflow.register()
and run via UI. When run via flow.run()
it does not store anything. What do I have to do to not store anything? This keeps filling up storage on my server. It is just an example, it seems to me to be related to the mapping.
from prefect import Flow, task
from string import ascii_lowercase
@task(checkpoint=False)
def extract_things(c):
return c
with Flow(
"Do it",
) as flow:
extract_things.map(list(ascii_lowercase))
josh
07/17/2020, 11:20 AM.map
. Constants are special tasks in prefect with their own logic and if you want to control that behavior you should instead wrap it in a task declaration like this:
@task(checkpoint=False)
def get_list():
return list(ascii_lowercase)
@task(checkpoint=False)
def extract_things(c):
return c
with Flow(
"Do it",
) as flow:
l = get_list()
extract_things.map(l)
Matthias
07/17/2020, 11:43 AMParameter
. As Parameter is a also a special task, os there a way to disable checkpointing here as well, @josh?josh
07/17/2020, 12:13 PMMatthias
07/17/2020, 12:48 PM