Hi again, theoretical question.
If most use Docker/K8s to run dataflow on (each dataflow has own image, or each flow executes common image), why do we need Agent at all?
k
Kevin Kho
05/05/2022, 1:44 PM
The agent is the done that spins up the new job and deploys the container/pod. The flows do not need to be using a common image and in general, the Agent process is the one that looks for Flows to run from Prefect Cloud. The agent and Flows do different things
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.