https://prefect.io logo
Docs
Join the conversationJoin Slack
Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-australia
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by Linen
introductions
  • t

    tim busfield

    11/17/2021, 9:41 AM
    Hi, I'm Tim - Data Engineering Manager at Jaguar Land Rover, I'm evaluating Prefect Cloud alongside some other tools, my current sticking point is how to go about setting up an Agent to use with Prefect Cloud - if anyone can recommend a tutorial that'd be really helpful. Can a local Agent work with Cloud?
    👋 18
    a
    c
    +8
    • 11
    • 11
  • a

    Antonio Manuel BR

    11/19/2021, 1:54 PM
    Hi, I'm Antonio - researcher at Khaos, I'm evaluating the benefits of using Prefect core for a real-time ML pipeline :)
    👋 15
    a
    j
    +6
    • 9
    • 8
  • d

    Daniel Chapsky

    11/19/2021, 6:45 PM
    Hey All, I’m Dan. Head of data science at a crypto exchange. Looking forward to learning from everyone and not using Airflow!
    👋 18
    k
    a
    +6
    • 9
    • 9
  • i

    Ido Slonimsky

    11/21/2021, 8:53 AM
    Hey everyone! 👋 I'm Ido, Developer at a data driven start up, learning about Prefect and how it can benefit us 🙂
    👋 16
    a
    j
    +3
    • 6
    • 5
  • m

    Manuel Gomes

    11/21/2021, 5:22 PM
    Hi everyone! I'm a general-purpose tinker that finds himself in the need of workflows for a thingy I'm building. Python is kinda new to me, Prefect is kinda new to me... but I'll try not to frustrate you fine folks too much 🙂
    👋 17
    j
    a
    +3
    • 6
    • 6
  • w

    Wilhelm Su

    11/21/2021, 8:56 PM
    Hey everyone, I'm Wil, handling a new DE role. I'm new to prefect as well, and I chose it after I found myself laughing while reading the docs (due to how simple and intuitive everything was, compared to the alternatives). Hope to learn new stuff from the community!
    👋 21
    k
    a
    +4
    • 7
    • 6
  • e

    Emma Rizzi

    11/24/2021, 3:21 PM
    Hi again! I'm coming back after joining a new Start Up a few weeks ago. I already tried Prefect in my previous job and really enjoyed it. Looking forward to convince my team again to use it to develop environmental indicators 🙂
    👋 18
    a
    e
    +7
    • 10
    • 9
  • s

    Saurabh Indoria

    11/25/2021, 3:20 AM
    Hi All! I am working with an AI company. Our core problem was to create dynamic flows, not only dynamic on input array, but literally defining the flow structure on user input. This is not a straightforward problem and we came up with a solution (using Prefect) by which we can achieve fully dynamic flows based on user inputs (including dependencies defined by the user input). Looking forward to being part of Prefect community and contribute to the best of my knowledge.
    🙌 3
    👋 14
    g
    k
    +5
    • 8
    • 7
  • c

    Carl Allen

    12/02/2021, 5:27 PM
    Hi! I work at a last-mile delivery company built on the gig model. Our data team just made the decision to start using prefect. I’ve been given the task of spinning the infrastructure. I’ve been running through the ECS docs but can’t get the container to actually start. Looking for where to get help with this.
    👋 15
    d
    g
    +2
    • 5
    • 10
  • b

    bitsofinfo

    12/03/2021, 6:31 PM
    Hi all - just starting to look into prefect. Can anyone point to any good articles/examples of generating dynamic dags in prefect?
    👋 11
    k
    c
    +4
    • 7
    • 8
  • s

    Sagi Timinsky

    12/07/2021, 7:00 PM
    Hi guys, I’m Sagi - VP R&D @ aidock. We are evaluating Prefect for deep learning model orchestration. Super excited to start working with Prefect. We are aws oriented running on eks and deploying via terraform. I found a great source to learn how to set everything up -

    https://www.youtube.com/watch?v=EwsMecjSYEU&ab_channel=Prefect▾

    any more tips and best practises? For example I know that it is pretty hard to migrate DBs in prefect, so I would like to connect prefect to amazon rds right away
    👋 13
    a
    d
    +4
    • 7
    • 6
  • y

    Yves Schleich

    12/08/2021, 6:13 PM
    Hey everyone 🙋‍♂️ I’m Yves, the CEO of Lyska. Lyska is enabling german small and media hidden commerce-champions to become more data-driven. For several years, we’re successfully navigating those commerce-champions through their journey to transform their current commerce model to digitalisation. In this context, we are increasingly encountering the same challenge: companies or people within are often unable to work independently with their data. Therefore, Prefect could become handy to navigate them accordingly through their data-challenges.
    👋 18
    n
    d
    +6
    • 9
    • 8
  • l

    Liam England

    12/12/2021, 4:28 PM
    Hi folks 👋 I'm a back-end engineer working with a startup in Canada. Just getting started with Prefect to build out our data pipelines!
    👋 16
    j
    a
    +4
    • 7
    • 6
  • a

    Aninda Bhattacharjee

    12/13/2021, 3:57 PM
    Hi Everyone 👋 I am a data-engineer working with a startup from US. Currently exploring Prefect to build our complex data-pipelines and so far loving it.
    👋 16
    k
    a
    +5
    • 8
    • 7
  • j

    Joel Hansen

    12/15/2021, 3:10 AM
    Hello all! I am a self taught Business and Financial Analyst interested in data automation and want to explore more about the workflow automation that Prefect has to offer. Looking to learn as much as I can.
    👋 14
    k
    n
    +6
    • 9
    • 8
  • a

    Alejandro Sanchez Losa

    12/17/2021, 4:11 PM
    Hi everyone I am a data engineer working for a large US company in Spain, trying to check the best way to work with prefect 🙂
    👋 18
    j
    n
    +5
    • 8
    • 7
  • y

    Yusuf Khan

    12/17/2021, 5:27 PM
    Hi everyone, my name is Yusuf Khan, I do data science and engineering work at Supernal. Trying out Prefect 🙂
    👋 18
    k
    a
    +6
    • 9
    • 17
  • a

    Andi Abdul Hafez Ramadhan

    12/21/2021, 7:48 AM
    Hello everyone, my name is Andi, I am currently working as a data engineer for a fintech company in Indonesia. I want to explore prefect more 🙏
    👋 15
    a
    d
    +5
    • 8
    • 7
  • a

    Andrea Nerla

    12/21/2021, 5:01 PM
    Hi folks, I'm a data engineer from Italy 🙂 happy to be here, get ready to answer my silly questions
    👋 16
    a
    j
    +3
    • 6
    • 5
  • i

    Ian Singer

    12/22/2021, 12:34 AM
    I everyone, my name is Ian and I am working on my first Prefect deployment
    👋 10
    j
    c
    j
    • 4
    • 3
  • i

    Ian Singer

    12/22/2021, 12:34 AM
    Does anyone have recommendations for which type of Agent to use for the cloud deployment?
    a
    • 2
    • 1
  • p

    Paul Gierz

    12/22/2021, 10:51 AM
    Hi everyone! I’m Paul, I’m working at a small computing center in climate modelling and we are starting to containerize and standardize our workflows from the zoo that it has been before, Prefect looks like a good choice for this!
    🌎 2
    👋 12
    a
    c
    j
    • 4
    • 5
  • e

    Eduardo Fernández León

    12/22/2021, 11:59 AM
    Hi all! I'm Eduardo, working in a geospatial location company. We've used the on-prem installation of Prefect in a GKE for a couple of projects and work like a charm 😎 . Now, I'm testing the Prefect Cloud for another use case. You're doing a very good job with this platform, congrats!!
    👋 14
    🌐 1
    a
    c
    +2
    • 5
    • 8
  • s

    Son Nguyen

    12/27/2021, 4:29 AM
    Hi everyone, my name is Son. I’m a software engineer, currently working for a fintech company. We’re trying out Prefect in replace of Airflow for building a new recommendation platform. Happy to be here.
    👋 12
    k
    e
    +2
    • 5
    • 4
  • m

    Manu Pillai

    12/27/2021, 2:21 PM
    Hi everyone, I'm Manu and I’m aligned as a solution architect on a project around trying out Prefect as an option for bioinformatics pipelines used in clinical genomic interpretation. It's nice to meet you all!
    👋 13
    e
    k
    +5
    • 8
    • 8
  • h

    Hiep Doan

    12/29/2021, 4:55 PM
    Hi everyone, I’m Hiep. I’m a data engineer at Twitter. I’ve been hearing a lot about Prefect so trying it out!
    👋 24
    n
    a
    +13
    • 16
    • 16
  • s

    Scott Treloar

    01/03/2022, 5:02 AM
    Hi everyone. I'm the founder of a next generation investment management firm where we are looking to use Prefect to build a sequential decision-making framework.
    👋 8
    k
    a
    +5
    • 8
    • 12
  • m

    Matthew Webster

    01/03/2022, 4:30 PM
    Hi all! I’m Matt from a K-12 EdTech startup called Kinvolved (https://www.kinvolved.com/) working to reduce chronic absenteeism in US schools. I’ve used Prefect on a small open source project before but we’re now evaluating it and Prefect Cloud for our customer ETL pipelines. Excited to join the group!
    👋 8
    k
    a
    +3
    • 6
    • 6
  • m

    Miles Metzger

    01/03/2022, 6:15 PM
    Hey everyone I'm the product manager for One More Game where we're making one more game. We're hoping to use Prefect to reduce the complexity in managing our data systems. Great to meet all of you!
    👋 12
    k
    n
    +5
    • 8
    • 7
  • d

    Daniel Kornhauser

    01/04/2022, 5:19 PM
    Hi everyone, just stating to productize a webapp for skimming life sciences papers quickly for Diligence and R&D. I look forward to using prefect for productize: harvesting from multiple sources, ingestion, indexing, nlp, analysis, etc … First time that I use slack as a BBS/IRC, feels weird, I have mostly used slack just for groups and DMs
    👋 13
    k
    a
    +5
    • 8
    • 9
Powered by Linen
Title
d

Daniel Kornhauser

01/04/2022, 5:19 PM
Hi everyone, just stating to productize a webapp for skimming life sciences papers quickly for Diligence and R&D. I look forward to using prefect for productize: harvesting from multiple sources, ingestion, indexing, nlp, analysis, etc … First time that I use slack as a BBS/IRC, feels weird, I have mostly used slack just for groups and DMs
👋 13
k

Kevin Kho

01/04/2022, 5:20 PM
Hi @Daniel Kornhauser! Welcome to Prefect! What is BBS?
Oh bulletin board lol
d

Daniel Kornhauser

01/04/2022, 5:21 PM
Yep, that tell you how old I am 😉
😂 1
a

Anna Geller

01/04/2022, 5:22 PM
Welcome @Daniel Kornhauser!
👋 1
a

alex

01/04/2022, 5:42 PM
Welcome @Daniel Kornhauser! Sounds like a super interesting use case!
👋 1
j

justabill

01/04/2022, 6:01 PM
Hey @Daniel Kornhauser, welcome to the community!
👋 1
d

Dylan

01/04/2022, 6:27 PM
Welcome @Daniel Kornhauser!
👋 1
j

Jenny

01/05/2022, 12:59 PM
Hi @Daniel Kornhauser. Welcome!
j

Jeremiah

01/05/2022, 1:53 PM
Hey @Daniel Kornhauser , really curious to see how it turns out!
View count: 4