Matthias07/17/2020, 9:44 AM
and run via UI. When run via
it does not store anything. What do I have to do to not store anything? This keeps filling up storage on my server. It is just an example, it seems to me to be related to the mapping.
from prefect import Flow, task from string import ascii_lowercase @task(checkpoint=False) def extract_things(c): return c with Flow( "Do it", ) as flow: extract_things.map(list(ascii_lowercase))
josh07/17/2020, 11:20 AM
. Constants are special tasks in prefect with their own logic and if you want to control that behavior you should instead wrap it in a task declaration like this:
@task(checkpoint=False) def get_list(): return list(ascii_lowercase) @task(checkpoint=False) def extract_things(c): return c with Flow( "Do it", ) as flow: l = get_list() extract_things.map(l)
Matthias07/17/2020, 11:43 AM
. As Parameter is a also a special task, os there a way to disable checkpointing here as well, @josh?
josh07/17/2020, 12:13 PM
Matthias07/17/2020, 12:48 PM