Has anyone ever tried running prefect flows through GCP lamb

Question

Has anyone ever tried running prefect flows through GCP lambda functions I m exploring how to support a mapped run of 1000s of tasks in parallel and am not sure whether to go the Google Kubernetes Engine route which Prefect has an agent for or lamda functions Would appreciate to anyone s experience

Rajvir Jhawar · Answer

Are you using prefect 1 or 2

Rajvir Jhawar · Answer

If your using prefect 2 I would suggest trying out the new cloud run integration if your ok with a beta product <https prefecthq github io prefect gcp cloud run >

Rajvir Jhawar · Answer

If you look at google s native cloud functions which are equivalent to AWS lamda that system now uses cloud run knative under the hood this is if you want to go without dealing with infra

Rajvir Jhawar · Answer

If you want something more stable then I would recommend using GKE autopilot google manages most the setup for you

Josh · Answer

I m running Prefect 1 but hoping to migrate to Prefect 2 in a couple of months