Does anyone have agent deployments in multiple cloud providers pointing to the same prefect cloud account? I have a use case where I plan to access some data in GCP, while my agents are deployed on AWS EKS clusters - I’ve considered going with some sort of peering approach, or simply standing up an agent on GCP GKE
k
Kevin Kho
02/08/2022, 9:54 PM
Cross-cloud is pretty rare here. Agents on GCP GKE sounds easier (and in-cluster agents are recommended), but maybe you can pull off the peering, I dunno.
l
Leon Kozlowski
02/08/2022, 9:58 PM
Yeah - I’m figuring that would be easier as well
Leon Kozlowski
02/08/2022, 9:58 PM
I shouldn’t see any issues so long as there are no agent label clashes though right?
k
Kevin Kho
02/08/2022, 9:59 PM
Yes for sure.
👍 1
l
Leon Kozlowski
02/08/2022, 9:59 PM
Thanks Kevin
k
Kevin Kho
02/08/2022, 9:59 PM
Outside of Prefect though, isn’t this painful because you get hit both for egress and ingress when moving data between clouds?
l
Leon Kozlowski
02/08/2022, 10:03 PM
Well, if I keep them completely separate - I shouldn’t hit that issue, in that the GKE agent flow runs only touches data in GCP, and the EKS agent flow runs likewise for AWS
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.