https://prefect.io logo
t

tas

08/15/2020, 10:34 AM
Hi All, I am looking at setting up Prefect on GCP and I did go through the medium post regarding that. I am looking for a server less solution to run the flows that will not have the overhead of setting up k8s. Something like Fargate on AWS ?
i

itay livni

08/15/2020, 2:01 PM
Hi @tas you can run flows with Fargate. In general the steps are (1) Decide where to store the flow (can be in the docker container) (2) Define a docker container (3) Define Fargate agent with configuration. Which is essentially the AWS task definition settings + labels https://docs.prefect.io/orchestration/execution/storage_options.html#non-docker-storage-for-containerized-environments https://docs.prefect.io/orchestration/agents/fargate.html#configuration
t

tas

08/15/2020, 2:32 PM
Thanks @itay livni but what I was looking for is a setup on GCP and not AWS. I was looking for an equivalent to Fargate on GCP
n

nicholas

08/15/2020, 10:21 PM
They're not quite identical @tas but Google Cloud Run is the analogous GCP solution. I'm not sure what the setup burden is for it nor what the specifics are for running it with prefect so perhaps some others can chime in if they've experience with that. In general the setup burden is lowered significantly by using Prefect Cloud (which is free 😄), which takes care of the database, API, caching, and UI layers, leaving you to set up only your execution environments and Agent.
t

tas

08/16/2020, 11:44 AM
Thanks @nicholas
2 Views