https://prefect.io
Join Slack
Hello everyone with one more prefect v2 question. When defining a docker infrastructure Is there an ...
# ask-community
g
Hello everyone with one more prefect v2 question. When defining a docker infrastructure Is there an option to tmpfs mount? In our flows we have a lot of temporary file operations that can benefit greatly.
c
Hi @Georgi Yanev - since these can be setup in mount options when starting a docker container, I believe these can be specified as runtime parameters in the deployment configuration
I would have to verify this to be certain, but you can modify the 
command
block in the deployment ; the command block is what the container uses to start itself, but the tmpfs options can be passed in when the container is started
There is the option to use volumes as well, if that’s an option?
I could be wrong on this, I believe we do support docker volumes, but I don’t believe tmpfs is supported at this time, I’d need to verify that and get back
g
it looks like the volumes option is limited only to standard mounting folder in the container. Tmpfs is handled differently in docker so I can't use the current functionality to add a tmpfs in the container.
c
Yea unfortunately that is the case for now - if you could describe your use case and how you are using tmpfs for this solution, I can check with the team about the possibility of adding this to the roadmap?
g
Sorry for the late response, but it was vacation time for me. We have a lot of flows which basically download a media file, reencode it and upload it again. And we do not want to stress our SSD drives with all this, so we want to use tmpfs in our docker workers
2 Views
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by