Also, is it possible to keep the agent separate from all the code dependencies by running flows in Docker containers and building all the dependencies within the Docker container? If so, is there a tutorial fo rthis?
✅ 1
r
Rob Freedy
11/10/2022, 3:35 PM
Hey @Kishan!! In 2.0, you can specify an image in the KubernetesJob block (looks like you are using GKE), which is the specifications for the execution environment that the flow runs in. If you specify an image in that block, prefect will pull the image down (with all the dependencies needed). I have found this overview of infrastructure blocks to be super helpful.
Here are some other links that could be helpful:
KubernetesJob DocsDocker Images infoSome more examples
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.