Hey all Data engineer thinking of making the switch from lui

Question

Hey all Data engineer thinking of making the switch from luigi and airflow to prefect We run spark jobs written in scala mostly pulling from GCP but will eventually migrate to Azure Also trying to move a bunch of BigQuery jobs in airflow under the same umbrella as the spark jobs i e taking a step away from Cloud Composer Will poke around here as I try to rebuild some pipelines

Anna Geller · Answer

Welcome to Prefect < Fredrik Lyford> and good luck for your migration crossed fingers

Rob Freedy · Answer

Welcome < Fredrik Lyford> wave

Jeff Hale · Answer

Welcome to the group < Fredrik Lyford> rocket

Bianca Hoch · Answer

Welcome to the community < Fredrik Lyford> sparkles

Aimee McManus · Answer

Hey < Fredrik Lyford> Welcome wave tada

Braun Reyes · Answer

Welcome

Chris Reuter · Answer

Welcome amp glad you are here < Fredrik Lyford>

Mason Menges · Answer

Welcome < Fredrik Lyford> Great to have you here smile

Laurie Hindes · Answer

Welcome to Prefect < Fredrik Lyford> Let us know how we can help

jawnsy · Answer

Welcome to the community < Fredrik Lyford> wave

Matt Conger · Answer

Welcome to the Prefect community Excited you are here < Fredrik Lyford>

David Abraham · Answer

Welcome to the Prefect community < Fredrik Lyford>

Taylor Curran · Answer

Welcome Fedrik

Christina Lopez · Answer

Welcome to the Prefect Community < Fredrik Lyford> wave skin tone 4