Andreas Eisenbarth
08/11/2021, 9:42 AMprefect.config.flows.checkpointing = True
or
os.environ["PREFECT__FLOWS__CHECKPOINTING"] = "True"
Instead, we need to ensure that no prefect
import statement (direct or indirect) occurs before setting this environment variable. It seems impractical that prefect reads such configuration in top-level code (executed on import) and not in functions. Are there any better solutions?Kyle McChesney
08/11/2021, 2:15 PM~/.prefect/config.toml
file.
Something like:
[flows]
checkpointing = true
Should be on whatever host/container the flows run in I think?Kevin Kho
refresh
method, certain changes would not take affect like logging. At the same time, we need that configuration instantiated to run Prefect.
The toml
is the only other option like Kyle is suggesting. on.environ
at the top of the script as you mentioned would work.Andreas Eisenbarth
08/11/2021, 2:33 PM.prefect/config.toml
, but there will probably come more things for which we need that.