Hi there! I'm working on understanding Prefect Cloud infrastructure. I'm coming from an Airflow background. I'm trying to understand the difference between orchestration infrastructure and task execution infrastructure when using Prefect Cloud. Prefect Cloud manages the orchestration infrastructure for you, but does it also manage the task execution infrastructure or do you have to set that up separately? If we wanted to, for example, run tasks in a docker container or as non-containerized python scripts.

That's my understanding as well - Containers, VMs, etc.

That's right @Austin Weisgrau, agents are essentially dispatchers that live in your cloud env and make the bridge between Prefect Cloud and your internal infrastructure. Prefect Cloud only manages the flow queue and stores the data (logs, task and flow statuses etc) that the agent sends it. Agents poll the queue using the Prefect REST API (which is great, as you don't need to give Prefect Cloud any kind of access to your cloud env for that to happen), pull pending flow run requests, then dispatch those requests to be run in a job runner. Jobs can be run in the agent's VM/container itself but the agent can also create, for instance, Kubernetes jobs to run those for you. That's the setup we've been using here actually.

Awesome thanks, that's really helpful!