https://prefect.io
Join Slack
Hi! I'm new to Prefect and wish to get some help from experts. We have a POC system using prefect. W...
# prefect-server
f
Hi! I'm new to Prefect and wish to get some help from experts. We have a POC system using prefect. We just do "prefect server start" to start a local server, and "prefect agent start" on the same server to run the code. Everything works fine for weeks. After some heavy load testing, we started to get error saying "Unexpected error: OSError(28, 'No space left on device') " If we run our code directly using flow.run(), it works fine. But if the same code for flow.register(), it failed with "Unexpected error: OSError(28, 'No space left on device') " We have tried to remove all images and clear docker volumes, but still getting this error. The disk space usage looks OK on that server. Can someone help to shed some light on this issue? Thanks in advance
z
This is likely due to flow result storage which defaults to 
<prefect-home-dir>/results
— 
python -c "import prefect; print(prefect.config.home_dir)"
Are you sure the homedir isn’t on a different drive?
f
Thank Michael! The homedir is currently on my home directory which is very possible why. Can you guide me how to change the homedir setting?
-bash-4.2$ python -c "import prefect; print(prefect.config.home_dir)" /home/fcheng1/.prefect -bash-4.2$
Is there an easy way to change the value of the prefect.config.home_dir setting?
z
Yep! Just change your config file
Or pass an environment variable
Copy code
# base configuration directory (typically you won't change this!)
home_dir = "~/.prefect"
in the config file
I’m not actually sure what happens if you change that because then it’ll look for things elsewhere
I’d recommend just changing your flows to use a 
LocalResult(...)
with a set directory
f
I deleted the files in /home/fcheng1/.prefect/results and our flows start successful again! Thank you very much! I'll try to implement the LocalResult method to resolve this properly. 🙂
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by