Hey all,
What are the recommandations to make Prefect access resources from different vpcs?
My use case => I have several internal databases (not exposed to internet) that are running in different vpcs and I would like Prefect to query them. I am wondering what are the recommandations to do so? Or if there is a guide I could follow 🙂
i
Islam Otmani
09/27/2023, 11:20 PM
Hi Hugo,
There's probably many ways to go about this, but I think setting up a work-pool for each VPC is ideal here, and have a workers running within those VPCs run the queries.
https://docs.prefect.io/latest/concepts/work-pools/
Islam Otmani
09/27/2023, 11:21 PM
You can have workers poll prefect for work, or use 'push pools' that are serverless triggered by Prefect.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.