Hey, I am new with Prefect.
When you run a flow using Local Agent, where does the flow and the tasks exactly run? Does it run as a Python process or does it run inside a docker container..? Or where a task/flow will run depend on the type of agent? How can this be configured?
Cause when I start the prefect server, several docker containers are run...
k
Kevin Kho
06/28/2021, 1:41 PM
Hi @Shivam Shrey, for the Local Agent, it creates a new process and runs a flow. If you want to run a Docker container, you should use the Docker Agent. The agent is separate from Server, which is a backend. The agent is responsible for pinging Server and checking if there are flows to execute. Prefect Server does indeed use Docker-compose. Just so you know also, Prefect Cloud comes with 10000 free task runs, which is a lot to get started with.
s
Shivam Shrey
07/05/2021, 10:31 AM
So does that mean, if I use docker agent and DockerRun, the agent will run in a docker container and all the tasks from the flow will also be executed inside this docker container?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.