Channels
#prefect-server
Title
# prefect-server
f
Frank Cheng
12/21/2020, 6:59 PMHi! I'm new to Prefect and wish to get some help from experts.
We have a POC system using prefect. We just do "prefect server start" to start a local server, and "prefect agent start" on the same server to run the code. Everything works fine for weeks.
After some heavy load testing, we started to get error saying "Unexpected error: OSError(28, 'No space left on device') "
If we run our code directly using flow.run(), it works fine. But if the same code for flow.register(), it failed with "Unexpected error: OSError(28, 'No space left on device') "
We have tried to remove all images and clear docker volumes, but still getting this error. The disk space usage looks OK on that server.
Can someone help to shed some light on this issue? Thanks in advance
z
Zanie
12/21/2020, 7:14 PM
This is likely due to flow result storage which defaults to
<prefect-home-dir>/resultspython -c "import prefect; print(prefect.config.home_dir)"Are you sure the homedir isn’t on a different drive?
f
Frank Cheng
12/21/2020, 8:37 PMThank Michael! The homedir is currently on my home directory which is very possible why. Can you guide me how to change the homedir setting?
-bash-4.2$ python -c "import prefect; print(prefect.config.home_dir)"
/home/fcheng1/.prefect
-bash-4.2$
Is there an easy way to change the value of the prefect.config.home_dir setting?
z
Zanie
12/21/2020, 9:17 PM
Yep! Just change your config file
Or pass an environment variable
Copy code
# base configuration directory (typically you won't change this!)
home_dir = "~/.prefect"I’m not actually sure what happens if you change that because then it’ll look for things elsewhere
I’d recommend just changing your flows to use a
LocalResult(...)f
Frank Cheng
12/21/2020, 10:25 PMI deleted the files in /home/fcheng1/.prefect/results and our flows start successful again! Thank you very much! I'll try to implement the LocalResult method to resolve this properly. 🙂
2 Views