Hi all, for an instance of Prefect Server, what are the recommended specs for a system to run Prefect effectively?
k
Kevin Kho
04/30/2021, 1:39 PM
Hi @Matthew Blau, I’ll ask the team about this
m
Matthew Blau
04/30/2021, 1:42 PM
@Kevin Kho thank you! We have some tasks that run every ~10 minutes and they fail a lot due to a time out of creating the docker container; feel like it's due to the available resources on the server so I'm hoping we can provision a server for Prefect that meets some recommended specs
t
Tyler Wanner
04/30/2021, 3:47 PM
Hi Matthew, which Docker container are they failing to create? Are you talking about flow execution containers? There are no current recommended specs but if anything is "too low" we'd love to know
m
Matthew Blau
04/30/2021, 7:17 PM
Hi @Tyler Catanzaro, we build docker images with docker -compose and have a basic task that creates the container, starts it, and then collects logs. When the task fails we see
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.