Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
j
Josh
10/14/2022, 4:48 PMHas anyone ever tried running prefect flows through GCP lambda functions? I’m exploring how to support a mapped run of 1000s of tasks in parallel, and am not sure whether to go the Google Kubernetes Engine route (which Prefect has an agent for) or lamda functions. Would appreciate to anyone’s experience.
r
Rajvir Jhawar
10/14/2022, 5:02 PMAre you using prefect 1 or 2?
If your using prefect 2 I would suggest trying out the new cloud run integration if your ok with a beta product:
https://prefecthq.github.io/prefect-gcp/cloud_run/
👍 1
If you look at google's native cloud functions (which are equivalent to AWS lamda) that system now uses cloud run (knative) under the hood (this is if you want to go without dealing with infra)
If you want something more stable then I would recommend using GKE autopilot (google manages most the setup for you)
👍 1
j
Josh
10/14/2022, 5:56 PMI’m running Prefect 1. but hoping to migrate to Prefect 2 in a couple of months