Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Does anyone have agent deployments in multiple cloud providers pointing to the same prefect cloud account? I have a use case where I plan to access some data in GCP, while my agents are deployed on AWS EKS clusters - I’ve considered going with some sort of peering approach, or simply standing up an agent on GCP GKE

Cross-cloud is pretty rare here. Agents on GCP GKE sounds easier (and in-cluster agents are recommended), but maybe you can pull off the peering, I dunno.

Yeah - I’m figuring that would be easier as well

I shouldn’t see any issues so long as there are no agent label clashes though right?

Outside of Prefect though, isn’t this painful because you get hit both for egress and ingress when moving data between clouds?

Well, if I keep them completely separate - I shouldn’t hit that issue, in that the GKE agent flow runs only touches data in GCP, and the EKS agent flow runs likewise for AWS