Hi everyone! I am a Data Architect at Align AI looking into orchestration solutions.

Hi Team 🙂 Just wanted to introduce myself. My name is Taylor and I am a new Sales Engineer at Prefect. I like reading.. 📚 I’m currently in the middle of The Changing World Order and Fall of Giants (when I need a fiction break). I always love getting book recommendations, so send any my way! I am looking forward to learning so much from this community and helping to answer as many questions as I can. cool llama

Hello! My name is Massimiliano Fanciulli and i'm working on building a Prefect + Dask cluster for data processing.

Hello Everyone, My name is Onkar and I’m working as a Software Engineer for OpenMetadata. At OpenMetadata we are implementing a metadata management solution that includes data discovery, governance, data quality, observability, and people collaboration. We are also partnering with Prefect to make OpenMetadata work with the Prefects workflows! Nice to meet everyone.

Hello everyone, I am Matteo, a data engineer at Laserhub. I decided that prefect will be our data orchestration tool! Nice to meet you!

Hi all! 👋 Jeff Hale here. I’m excited to be starting as a Developer Advocate at Prefect! I’ll be creating resources to help people learn about Prefect.prefect duck

Hi All, Rohan here. Data Engineer at Memories Group Limited. I am currently in the process of migrating from prefect server to cloud.

Hi Everyone! My name is Matt Conger and I am exciting to be joining the Prefect team for the summer as a Prefect Community Engineering Intern. Looking forward to getting to learn from and work with the community. prefect duck

Hi All. My name is Michael Ng. I'm the Director of Data Science at Intrinsic Brands. We're an early stage startup standing up our data stack, and we are starting to experiment with Prefect to orchestrate our flows.

Howdy, My name is Luis, I’m the VP of Engineering at Tani Salud, an healthtech early startup in Mexico, A few colleges recommends me this tool, and we are triying to orchestrate our data flows

Hi All, My name is Amit Gupta. I’m cofounder and CTO of TrulyMadly, Leading dating app in India. I found about Perfect while doing research about automating ETL and Data science workflows. It’s quite intriguing. Hoping to migrate our ETL and data science workflow soon to Perfect.

Hi Everyone, My name is Surawut. I’m a Data engineer. I just joined the

course-mlops-zoomcamp

and learn about Prefect. hope to use Prefect in the future ML pipeline’s corp.

Hey there! 👋 I’m Dominik, the sole Data Engineer for German non-profit organisation

betterplace

. I’m in the process of building a data stack that primarily revolves around ELT workflows on GCP with airbyte, dbt and BigQuery. Prefect looks like a nice solution to simply (and cheaply) schedule dbt jobs with the possibility to easily scale out to more complex workflows in the future. An initial question: If I want to deploy prefect(open source) myself on GCP, would the recommendation be to do so all in a kubernetes cluster, or something else? 🤔 🙏

Hello! I'm Iulia ( iulia not Lulia xD), and I am an aspiring Java software developer. I have got 3 years of hands-on experience with it, along with some SQL, Spring Boot, Maven, CircleCI, and many others! I love tinkering with both new and old projects. Currently in the process of finding a part-time job or a full-time one for my coop winter term.

Hi All, This is Abin, I am developer from Canada, working for public sector project. New to PREFECT, trying to set up PREFECT on private OpenShift - due to privacy/FOIPPA . Quick Question : if any one has set up PREFECT on Openshift using yaml templates please let me know, it will be great help

Hey - Steve from sunny Manchester, UK here - I am looking to replace our current airflow implementation with Prefect

Hi Everyone, Zheng Cheng from China here, our use case for Prefect is complex data analysis, at the beginning we are using ClickHouse and Superset for data visualization, Our main app is Ruby on Rails, database is PostgreSQL. ClickHouse just copy everything in PostgreSQL. And Superset query the ClickHouse to show graph. As more question asked, our SQL in Superset (aka Virtual Dataset) grow longer and longer, to a point that difficult to manage and reason about. so we use “dbt” to break these ~100 line SQL into multiple “dbt models”. But just SQL is still not enough, We need to write Python to do some “data transformation” work. We want the trigger Python when things happen, so the data visualization on Superset is “near realtime” We need to use Python to read data from ClickHouse, and write something back to ClickHouse. We don’t want to use Flask or Django for that. (negative engineering) After some investigation, we found that Airflow and Luigi is “first generation” tools, they are way too complex. We don’t care about DAG. Dagster is kinda early, Prefect seem nice. that’s why I am here. 🙂 Update: I need to make Python code can be trigger by a HTTP Request, Not sure how to use Prefect to do that

Hello Everyone! Will from North Carolina here, Prefect is wonderful and so is this community! I have a background in Atmospheric Science and all things "Ops". My team has been using Prefect 1.0 for the 6 months to scale out a deep learning factory within the population health space.

Hi, Rodrigo here. I'm currently evaluating whether to use airflow or prefect to orchestrate data pipelines.

Hello everyone 👋, I am Thinam Tamang. I am an NLP Developer and I have been learning Prefect 2.0. It's great to connect with you all here.

Hello folks! Hello Folks! I'm a researcher, professor, and ML Lead at AI Lab @ Universidade de Brasilia/Brazil. We are reviewing our MLOps stack, and there is a high chance that Prefect is gona replace airflow. It's encouraging to found a very active community. I'm Looking forward to sharing experiences! Best wishes!

Hi y’all! I’m a (almost finished?) phd student in applied math at princeton 🐯 in the beautiful, industrious state of new jersey. Besides enjoying the best pizza and bagels you can find, I do a lot of data analysis and machine learning work that involves quickly spinning up experiments and firing them off onto various computing clusters. I’m looking to incorporate prefect into my workflow so I don’t have to worry about orchestrating the etl parts of my math research! shoutout to @Nate for the help so far and pointing out this slack!

Hello all. I'm a retired engineer turned programming junkie. Read an article on Medium.io today about Prefect and I'm hooked. I've banged my head against the wall for months trying to figure out how to implement AF as a one man band. Took me about 10 minutes to realize the beauty of Prefect.

Hi all, I have just demonstrated results of my PoC to my team. I have got green light to replace our Talend jobs (they are docker containers) with Prefect2.0 code. So at the beginning we will just replace Talend's containers with Prefect containers, so it's transparent for other parts of our system. After that we will see if / how we can use other Prefect features, like Clound and kubernetes deployment. Thank you all for your help and have a nice day

Hello Everyone, My name is Emil Ordoñez. I work as a Data Engineer at Intrinsic Brands. We are currently starting to implement Prefect as our orchestration tool/platform. We're going to be using it to orchestrate a set of tools containing, but not limited to: • Fivetran ingestions • Integrator.io flows • DBT jobs • ML models built both on R and Python

Hi All I’m a senior DE and am currently in the process of creating a POC with Prefect as I start to look for an orchestration/pipeline framework and have come across Prefect having used Airflow in previous roles. Excited by the initial exploration with it.

Hi all, I'm Viet Nguyen, I'm a software engineer for University of Tasmania, Australia (Research division). My team is Integrated Marine Observing System and we're enabled by the Australian Government. We're looking for comprehensive solutions and tech stacks that can help our pipelines of transforming ocean data catalogues into cloud-optimised format. And Prefect looks like an ideal solution, Looking forward to sharing experience. Have a nice day. Cheers.

Hi all, I'm Andy Hudson. I'm Solution Architect at Vizolution Ltd in Swansea, UK. Starting to investigate Prefect as an alternative to Airflow. Looking forward to learning what it can do.

Hey there, I'm Lyn and I'm soon to start work as a pipeline architect at a Vfx firm. I'm very impressed with the philosophy of Prefect 2.0 and I'm evaluating the possibility of using it to manage day to day business workflows in conjunction with Kafka.

Hello All, I'm Pierre-Edouard Caron, a french devops engineer working at OVHCloud on the email security team (spam/virus filtering). We really love prefect for data manipulation 🙂 I hope to learn a lot with this community !