Morning all! Curiosity question, anyone tried cross cloud platform usage? I.e. host Prefect server and agent on AWS and run a flow on Digital Ocean?
05/29/2020, 12:05 PM
Hi @Darragh - I've tried a similar setup with Prefect Cloud,, an Agent on DO, interacting with some AWS services (primarily S3 and RDS); didn't have any issues with that setup at all. I'm not sure what you mean by running the flow on DO though, do you mean using DOCR?
05/29/2020, 12:26 PM
Hey nicholas - we'll be runing the agent on AWS, most flows will be on AWS but some of the flows will be run on a digital ocean cluster, possibly/probably from a FlowRunTask. Is there a common method or Task for reaching out to DO?
05/29/2020, 12:47 PM
Hm, I'm not sure I understand, the agent is responsible for running all flows (be that in-process or as the interaction point between something like a Kubernetes cluster. They can be stored and pulled from DOCR or possibly DO Spaces but otherwise I'm not sure I follow.
As for communication with DO, there's no DO-specific tasks in the Task library but in my experience any tasks that take advantage of BOTO3 (like the AWS S3 tasks) can usually work with DO
05/29/2020, 12:51 PM
I may need to confirm that qith our experts as well..