Hi guys, Is there anyone who knows about Prefect 3.X with Docker who could clarify a few points for me? Would be very nice as I'm not sure to understand the documentation right

Give some direction about what you need help with. Deploying the server with docker? Running docker workpool?

Thanks for your answer! I want to run my flows in a docker swarm cluster. However I don't really get how the worker is created to run inside my cluster, and how my flows are directly integrated into this cluster as well... Do I just need a small dockerfile with a

prefect worker start -p "my-pool" --type "docker"

command ? But then how are my flows directly linked ? Do I need to create a dockerfile for each flow and to push-pull-deploy a service for each flow ?

Do you have complex flows? (with sub-flows and tasks?)? Do you wish the flows to run on the same "pod" and share resources? Do you wish to use the infra-flexible solutions based on usage (instance per run) or to have a fix number of pods that will handle the flow? Do you wish to "share" the load between multiple pods or for each pod to have a specific flow it will handle?

I want something scalable so I can have some big flows, some small ones... (I plan to have one repository and one CI/CD per flow). I think the infra-flexible solution would be the best one (as I have some flows that will be high ressource-consuming but would not run often). Not sure about the last question.. I think I'd like to share the load between the pods

It sounds like you first need to design your architecture or your requirements from it. After you do that, prefect can support so many architectures with different implementations (deployments from source/docker images). You'll also have to design your source code based on the main architecture. Personally, I suggest you not to design it through Slack messages because we don't fully understand all of the system and requirements. If you wish, I can have a VC with you sometime next week to give you general directions. BTW - I'm not part of the prefect team - just a user like you

Would be really great to have a VC next week 🙏 Don't want to take too much of your time, really appreciate