Is there a way to change the location of the temporary working directory that is used by prefect v2?

jack

01/11/2023, 5:41 PM

Is there a way to change the location of the temporary working directory that is used by prefect v2?

Christopher Boyd

01/11/2023, 5:50 PM

This should help I think? https://discourse.prefect.io/t/can-i-change-the-location-of-the-agent-tmp-tmp-prefect-to-home-tmp-prefect-when-executing-a-flow/1343/7

jack

01/11/2023, 6:34 PM

Can you find out which setting (if any) controls the location of the temporary working directory? It appears that neither

PREFECT_HOME

nor

PREFECT_LOCAL_STORAGE_PATH

is the correct one.

Christopher Boyd

01/11/2023, 6:54 PM

the default behavior is based on your system env settings, you can run

env | grep -i tmp

to see what your system setting is, and change it there

Christopher Boyd

01/11/2023, 6:54 PM

but that’s python and OS specific, not a prefect setting

Christopher Boyd

01/11/2023, 7:01 PM

This explains the behavior - https://stackoverflow.com/questions/847850/cross-platform-way-of-getting-temp-directory-in-python

jack

02/28/2023, 8:06 PM

It appears one change the location of the ephemeral temp directory where a flow run is executed by setting the

TMPDIR

environment variable before starting the prefect agent. Perhaps we should document this somewhere.

2 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.