Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi everyone,
With prefect 2.0 :
Is it possible to use prefect.inrastructure to run a docker on Azure outside the agent ?
My VM where I install the agent have 1Go of RAM, but I want to set up a docker task (like FARGATE on AWS) with more ressources to execute the flow.
Or should I go straight to kubernetes ?
Someone have tried Kubernetes on Azure for this ?

Hi Benjamin ,

It seems like your question is that you have an agent on a VM but want to execute jobs elsewhere , such as docker and/or kubernetes ?
We have some good documentation on those , I can get you some links.

For running Kubernetes jobs (this is in Azure but doesn’t have to be ) - <https://discourse.prefect.io/t/prefect-1-0-prefect-2-0-kubernetes-run-config-to-kubernetesjob-infrastructure-block/1229>

<https://docs.prefect.io/concepts/infrastructure/#kubernetesjob>
<https://docs.prefect.io/concepts/infrastructure/#dockercontainer>

If you are building the deployment, the agent can spin up the infrastructure block defined in the deployment, and execute that - whether it’s in Docker, or in Kubernetes

Roger that, thanks a lot ! Gonna work on it