Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi, My names Josh - I lurked around here and asked a few questions towards the start of 2021 in a previous job - started at a new place and I am taking on the role of lead Data Engineer - Would love to understand peoples experiences with using Vertex on GCP is this a robust way of using Prefect? In the past tried to run everything myself on k8s but was far to much pain than it was worth!

Hey <@U033YB7DC6L>! Glad to see you again :slightly_smiling_face:

Hi <@U033YB7DC6L>, sounds like you got a better job? Congrats! There is a blog by Chris Aderne on Vertex <https://rdrn.me/scaling-out-prefect/|here>

Haha a different job - not particularly comparable! That looks like a great resource - it does funnily enough end with suggesting a future move to k8s though! Although the reason suggested (slow start up time) is not really something that concerns me

Welcome to the community <@U033YB7DC6L> and congrats on your new job! :wave: