https://prefect.io logo
g

Georgi Yanev

09/07/2022, 10:34 AM
Hello everyone with one more prefect v2 question. When defining a docker infrastructure Is there an option to tmpfs mount? In our flows we have a lot of temporary file operations that can benefit greatly.
c

Christopher Boyd

09/07/2022, 12:58 PM
Hi @Georgi Yanev - since these can be setup in mount options when starting a docker container, I believe these can be specified as runtime parameters in the deployment configuration
I would have to verify this to be certain, but you can modify the
command
block in the deployment ; the command block is what the container uses to start itself, but the tmpfs options can be passed in when the container is started
There is the option to use volumes as well, if that’s an option?
I could be wrong on this, I believe we do support docker volumes, but I don’t believe tmpfs is supported at this time, I’d need to verify that and get back
g

Georgi Yanev

09/07/2022, 7:58 PM
it looks like the volumes option is limited only to standard mounting folder in the container. Tmpfs is handled differently in docker so I can't use the current functionality to add a tmpfs in the container.
c

Christopher Boyd

09/09/2022, 8:28 PM
Yea unfortunately that is the case for now - if you could describe your use case and how you are using tmpfs for this solution, I can check with the team about the possibility of adding this to the roadmap?
g

Georgi Yanev

09/24/2022, 9:25 PM
Sorry for the late response, but it was vacation time for me. We have a lot of flows which basically download a media file, reencode it and upload it again. And we do not want to stress our SSD drives with all this, so we want to use tmpfs in our docker workers
3 Views