https://prefect.io logo
Join the conversationJoin Slack
Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-australia
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by Linen
introductions
  • t

    Thomas Mathew

    04/23/2021, 5:53 PM
    Hi Everyone, I am Thomas, i work with Mindtree and lead the delivery of Azure data lake implementation for one of our customer. We got interested in prefect to orchestrate all the jobs for different data sources to load the data into data lake and derive insights. It is exciting to be here to work on this new patform to understand it better and how we can suggest customer why Prefect is the best choice
    👋 7
    n
    k
    j
    • 4
    • 3
  • c

    Chris McClellan

    04/24/2021, 10:46 PM
    Hi, I live near Sydney, Australia. I own a data visualisation consulting company specialising in Tableau, Alteryx and Snowflake but we've been doing more bespoke Python ETL/ELT work lately and a friend mentioned Prefect. What I'm looking for (I might even write it myself if it doesn't exist) is a quick-start/cheat-sheet on how to get your existing process running on Prefect Cloud quickly. Does that sort of thing exist, or is it the correct approach ?
    👋 8
    k
    n
    • 3
    • 2
  • j

    Johan Lundin

    04/28/2021, 3:28 AM
    Hi, I live in HK and work for https://www.linkedin.com/company/shell-street-labs/mycompany/ doing engineering of AI/ML/Quant stuff. Looking for someone that might have done custom HostAlias mappings for Kubernetes that can be used inside scheduled jobs. Having prefect agents running in multiple different AWS VPCs and would like to map the same name to different IPs since they use VPC endpoints.
    👋 7
    d
    • 2
    • 1
  • c

    Cornel Verster

    05/03/2021, 9:50 AM
    Hi all! Cornel Verster here from South Africa, working for a global mining group in the Zinc industry and managing a data engineering and analytics team. Investigating Prefect as a potential ETL tool and glad to find a community like this to connect with!
    👋 7
    k
    d
    • 3
    • 2
  • r

    Rebecca Servaites

    05/03/2021, 5:38 PM
    Hi everyone!! I'm Rebecca!! I joined to get tips and troubleshooting for setting up Prefect on an internal Kubernetes cluster. :)
    👋 6
    k
    m
    +2
    • 5
    • 4
  • m

    Matthias Roels

    05/06/2021, 2:47 PM
    Hi everyone! I am a data scientist/machine learning engineer working at a small Belgian consultancy company. I have been stumbling on Prefect as an alternative for Kubeflow pipelines to build machine learning pipelines. This would allow Data engineers and Data scientists to use the same orchestration tooling, which simplifies the data platform architecture. I recently have been moving away from a notebooks way-of-working with MLflow and I really like it! Since MLflow offers limited to no support for pipelines I think these two technologies can nicely complement each other.
    👋 7
    k
    d
    • 3
    • 2
  • n

    Niko Usai

    05/07/2021, 8:40 AM
    HI everyone, I'm a software architect from Italy working in a consultancy company we're using PrefectHQ for some of our internal tooling
    👋 7
    m
    k
    d
    • 4
    • 3
  • d

    Devin McCabe

    05/07/2021, 4:42 PM
    HI, Prefect people. I'm a manager of a small data engineering team at Harvard. We've just started migrating a bespoke ETL pipeline to Prefect. It seems like a great product so far and I'm looking forward to seeing how it can simplify our pipelines.
    👋 9
    k
    d
    • 3
    • 2
  • n

    Nelson Griffiths

    05/07/2021, 8:58 PM
    Hi! I am a data scientist that works for a hedge fund part time in an ML Infrastructure position. I am working on changing a bunch of random shell scripts running on cron deployed by the engineering team into a system where data scientists can deploy their models with Prefect on their own. I’m excited to see the cool things other people are doing here!
    👋 8
    d
    • 2
    • 1
  • j

    Josiah Berkebile

    05/12/2021, 3:46 PM
    Hey all, I'm a data engineer and functional programmer. Looking into Prefect as a viable alternative to Airflow after coming across this blog post: https://medium.com/the-prefect-blog/why-not-airflow-4cfa423299c4 The list of things Airflow doesn't support natively hit home with my own past experiences
    👋 8
    k
    d
    +3
    • 6
    • 23
  • r

    Rachel Funk

    05/13/2021, 7:43 PM
    Hello! I'm a data engineer, and I just inherited a program that is using Prefect. Excited to learn more about it.
    👋 5
    k
    d
    • 3
    • 2
  • s

    Snehotosh

    05/14/2021, 3:05 PM
    Hi All, I am a Lead Architect and excited to explore Prefect for ML workflow.Thanks.
    👋 5
    n
    k
    d
    • 4
    • 3
  • j

    Joey Kellison-Linn

    05/14/2021, 3:59 PM
    Hi all! I'm newly hired data engineer who is looking into using Prefect to replace the existing cron system at the company
    👋 7
    j
    k
    d
    • 4
    • 3
  • s

    Semih Korkmaz

    05/14/2021, 10:13 PM
    Hi Semih Korkmaz here from Stoovo
    👋 4
    k
    d
    • 3
    • 2
  • s

    Semih Korkmaz

    05/14/2021, 10:14 PM
    We are looking to start on our new ETL system with Prefect!
  • e

    Erick Heredia

    05/17/2021, 12:59 PM
    Hi all. I'm Erick. I'm a Data Scientist trying to wrap my head around Prefect.
    👋 3
    🙌 1
    z
    k
    • 3
    • 11
  • g

    gotham

    05/21/2021, 6:18 PM
    Hello Prefectians 🙂, just starting out on Prefect, at our Organisation we are trying to use Prefect with Elasticsearch just wanted to know if anyone had any experience to guide me with this or if you could kindly redirect me to the appropriate channel. Excited !!
    d
    • 2
    • 1
  • a

    ash

    05/21/2021, 8:13 PM
    Hello everyone, I am a Data Science Engineer from India. I am pretty new to workflow management and pipelining and looking forward to learn Prefect to solve such problems. Hoping to learn a lot from you guys.
    👋 4
    :thank-you: 2
    d
    • 2
    • 2
  • j

    joshua mclellan

    05/24/2021, 10:39 PM
    hey there, Boston developer here investigating prefect as one of a couple tools we might integrate into our infrastructure. Hoping to get some one or two questions answered before we make a decision
    👋 3
    n
    k
    d
    • 4
    • 3
  • a

    Ayomide Aro

    05/25/2021, 11:47 AM
    Hey here…. I work as a Data Engineer based in Nigeria. Just starting out Prefect for processing blockchain data
    👋 5
    k
    d
    j
    • 4
    • 3
  • r

    Raúl Mansilla

    05/25/2021, 4:25 PM
    Hello from Madrid, Lead Media Engineer for a big american streaming company, I´m new to Prefect…hope to learn a lot about the tool!
    👋 3
    n
    k
    +3
    • 6
    • 6
  • v

    Vignesh Krish

    05/25/2021, 5:20 PM
    Hi there from Copenhagen, Data engineer / data scientist from a energy optimisation company, I’m new to Prefect and using it for processing and handling electricity market data. Hope to learn a lot more about it!
    m
    k
    +2
    • 5
    • 4
  • c

    Carnegie Johnson

    05/25/2021, 5:38 PM
    Yay! I made it to the Prefect workspace via #MSBuild2021 Thanks Chris and Kevin. I look forward to learn more about Prefect.
    👋 7
    🚀 7
    k
    d
    j
    • 4
    • 3
  • h

    Haseeb Mohammed

    05/26/2021, 5:36 PM
    #MSBuild2021 here as well. watching “Ask the Experts: Dynamic Workflow Orchestration with Azure Data Factory and Prefect” now. 🙂 hi folks!
    👋 5
    🚀 6
    n
    k
    +2
    • 5
    • 4
  • a

    Arkady K.

    05/26/2021, 9:50 PM
    Hi everyone !
    👋 4
    k
    • 2
    • 1
  • с

    Сергей Романкевич

    05/27/2021, 2:07 AM
    Hello frends! I'm Serge from Siberia! I'm PhD and working for the biggest regional food stores network https://www.sm-komandor.ru/en/.
    👋 4
    k
    • 2
    • 2
  • p

    Pietro Immordino

    05/28/2021, 4:48 AM
    Hello from sunny Hong Kong.
    👋 5
    k
    • 2
    • 2
  • h

    holger brandl

    05/29/2021, 7:55 PM
    Hi there, I find it a bit confusing that when running the tutorial without a local prefect instance, it just works fine for me doing:
    prefect backend server
    python 03_parameterized_etl_flow.py
    I can spin it up without problems using
    prefect server start
    but I was just curious what would happen in the examples without, so I stopped it and ran into the issue. Am I doing it wrong or did I miss some important concept here?
    k
    • 2
    • 2
  • c

    CM

    06/07/2021, 1:48 AM
    Hello everyone, happy to join!
    👋 7
    k
    • 2
    • 1
  • g

    Gabriela Leticia

    06/07/2021, 8:52 PM
    Hello everyone, i'm new here, happy to join!
    👋 5
    j
    k
    d
    • 4
    • 3
Powered by Linen
Title
g

Gabriela Leticia

06/07/2021, 8:52 PM
Hello everyone, i'm new here, happy to join!
👋 5
j

Jenny

06/07/2021, 8:54 PM
Welcome @Gabriela Leticia!
k

Kevin Kho

06/07/2021, 8:56 PM
Hi @Gabriela Leticia!
d

Dylan

06/07/2021, 10:08 PM
Welcome 👋
View count: 4