I'm deeply confused, and that's because I'm so not an infrastructure person. But let me beg for help. I'm pretty certain I want to use static infrastructure because I want to have a long running cache that stays valid between flows, and I want jobs to start quickly. I have built a container that uses
etc and if I run that container locally, i can then run jobs from the prefect cloud UI and everything works great. If I then want to run that container in Google Cloud Run instead, do I want a workpool? Or is that only for dynamic infra? If I want a workpool, should it be push or hybrid? What should my prefect.yaml look like? Thank you!!!!
n
Nate
11/20/2024, 2:22 AM
hi @Michael Natkin !
I think you already have the right idea, you only need to work pools for dynamic dispatch of infrastructure. So if you want a long lived container to run on Google Cloud run, you don’t need a work pool.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.