https://prefect.io logo
Docs
Join the conversationJoin Slack
Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-australia
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by Linen
introductions
  • u

    Uthman Yusuf

    09/13/2022, 5:47 AM
    Hello All, My name is Uthman from Nigeria, I have never used prefect before and I thought here would be a good place to start. I have a some Airflow background and I will appreciate any hint on how to get started. Thanks
    πŸ‘‹ 17
    πŸŽ‰ 2
    a
    s
    +8
    • 11
    • 12
  • g

    Giorgio Basile

    09/13/2022, 5:17 PM
    Hello, my name is Giorgio, I'm a software engineer working in the Earth Observation domain, and I'm using Prefect to build satellite data processing pipelines. Happy to join the community :)
    πŸ‘‹ 22
    πŸ›°οΈ 7
    🌐 3
    n
    c
    +10
    • 13
    • 13
  • t

    Thuy Tran

    09/15/2022, 4:13 PM
    Hi all. This community has been really helpful as I've been following along since beta to current release. I'm not sure where to post this so I'll ask here but if there is a better channel, let me know. I need to update my email address but I'm not able to. When I first requested access to this community, I used SSO with google. Who is the slack administrator for this community who can help me?
    a
    • 2
    • 1
  • d

    Dan Horne

    09/21/2022, 5:05 AM
    Hi all. I'm a Prefect n00b. Evaluating orchestration tools, and discovered Perfect today. Could be good fit.
    πŸ‘‹ 17
    s
    a
    +7
    • 10
    • 9
  • v

    Vikas

    09/21/2022, 6:48 AM
    Hello everyone I am Vikas Ojha and I am from India. I am a freelancer and currently working as a Lead Backend (Python) Developer I am very much willing to start using Prefect and also to help community whichever way possible
    πŸ™Œ 3
    πŸ‘‹ 16
    πŸ‘‹πŸ½ 1
    s
    a
    +5
    • 8
    • 12
  • d

    Deepanshu Aggarwal

    09/21/2022, 12:13 PM
    Hi everyone! I'm Deepanshu , working as a Data Engineer for a Saas Startup. I'm trying to do a poc on Prefect for our ETL needs. Happy to join the community :)
    πŸš€ 7
    πŸ‘‹ 25
    a
    a
    +8
    • 11
    • 10
  • j

    Joe Schueller

    09/27/2022, 2:49 PM
    Hi folks! πŸ‘‹ Been prototyping some things with Prefect over the last week or so and really enjoying it. Happy to be here!
    πŸ‘‹ 19
    j
    c
    +9
    • 12
    • 11
  • b

    badasstronaut

    09/27/2022, 4:53 PM
    Hi friends, I forgot my towel. Am I doomed? I’m an infrastructure engineer at an early-stage startup, and we’ve been running a POC on Prefect over the past few weeks. This is a great system, and I’m impressed with the quality of your python as well as the responsiveness of the team. Keep up the great work, and thank you for building such a powerful product. I have an AWS Fargate deployment of Orion & an agent. The agent can spin up an ECSTask infra block, and DaskTaskRunner creates a FargateCluster + autoscaling for tasks. Using Dask futures within a task enables us to have on-demand fractals of parallelism. Great stuff! I might just take off early for a Pan Galactic Gargle Blaster.
    πŸš€ 6
    πŸ‘‹ 20
    :gratitude-thank-you: 1
    πŸ‘‹πŸ½ 1
    c
    b
    +7
    • 10
    • 11
  • b

    Bradley McLaughlin

    09/27/2022, 6:36 PM
    Hello everyone πŸ‘‹ My name is Bradley McLaughlin and I'm a Data Engineer working with Prefect to enhance our ETL process. It's been a very useful service with a great community. Glad we made the switch!
    πŸ’― 6
    ✨ 2
    πŸ‘‹ 14
    a
    j
    +5
    • 8
    • 7
  • f

    Fredrik Lyford

    09/28/2022, 12:22 PM
    Hey all! Data engineer thinking of making the switch from luigi and airflow to prefect. We run spark jobs written in scala mostly pulling from GCP, but will eventually migrate to Azure. Also trying to move a bunch of BigQuery jobs in airflow under the same umbrella as the spark jobs (i.e. taking a step away from Cloud Composer). Will poke around here as I try to rebuild some pipelines!
    πŸŽ‰ 8
    πŸ‘‹ 21
    a
    r
    +12
    • 15
    • 14
  • j

    Jarvis Stubblefield

    09/28/2022, 8:08 PM
    Hello everyone, I work on multiple client projects and am thinking of multiple uses for Prefect. I'm working toward replacing Celery with Prefect. I have a Django project and there isn't a lot of documentation (none official) about using the Django framework with Prefect. I have found some resources and will ask for help if those fail. If anyone knows of any resources I'm all eyes... I will have some questions about using prefect agents on a Django web server. Look forward to interacting with the Prefect Community! πŸ™‚
    πŸš€ 7
    πŸ‘‹ 15
    πŸ™Œ 11
    m
    j
    +7
    • 10
    • 10
  • h

    Hongbo Miao

    09/29/2022, 9:56 PM
    Hi everyone, I am Hongbo who works at Archer Aviation. Just want to say I love Prefect sooooo much! After trying Prefect for a while, I feel the experience using Prefect is like iOS, while Airflow is like Windows Phone. Wish I could have found Prefect earlier. πŸ˜ƒ Cannot wait to learn more from everyone!
    ❀️ 3
    πŸ‘‹ 11
    πŸš€ 14
    m
    m
    +8
    • 11
    • 11
  • s

    Santhosh Solomon (Fluffy)

    09/30/2022, 7:27 AM
    Hi everyone, I am Santhosh Solomon from India. I am using Prefect for last 5 months to build scraper workflows in my organisation. Looking forward to get to know the community in a better way 🍻
    πŸŽ‰ 4
    πŸ‘‹ 18
    h
    a
    +4
    • 7
    • 7
  • g

    Ghawady Ehmaid

    09/30/2022, 7:43 AM
    Hi everyone πŸ‘‹ I'm Ghawady, working as a Machine Learning Engineer and sometimes wearing a Data Engineer hat for a Startup that focuses on NLP and data analytics. I've been working on building ETL and ML pipelines using Airflow for a year now, but want to evaluate Prefect if it would be a better fit for the future of the company while it grows. The first thing I did is join this community! Looking forward to learning more about Prefect and starting with a POC! If you have recommendations for good tutorials or complete beginner guides please send them my way πŸ˜ƒ
    πŸ‘‹ 20
    h
    c
    +10
    • 13
    • 12
  • p

    Pekka

    10/02/2022, 3:53 PM
    hello folks.
    πŸ‘‹ 19
    :marvin: 1
    a
    j
    +9
    • 12
    • 11
  • m

    Michael Shoemaker

    10/04/2022, 2:20 PM
    Hello all!!! Just joined and super stoked to be here!
    πŸ‘‹ 22
    πŸŽ‰ 5
    :party-parrot: 3
    j
    c
    +9
    • 12
    • 11
  • r

    Rob Barrette

    10/05/2022, 1:21 PM
    #clips doggo hello
    πŸ‘‹ 18
    πŸš€ 4
  • r

    Rob Barrette

    10/05/2022, 1:21 PM
    Hey Everyone.
    πŸ‘‹ 7
    a
    j
    +5
    • 8
    • 7
  • s

    Sven Balnojan

    10/06/2022, 9:52 AM
    Hey there, I'm Sven, DataOps Evanglist @ Meltano. Just poking around!
    πŸ‘‹ 16
    l
    j
    +6
    • 9
    • 9
  • b

    Brandon Reid

    10/06/2022, 11:28 AM
    πŸ‘‹ Hello! I just started at πŸ˜›refect: as a Design Technologist – on a mission to continue advancing the UX, interactivity, and style of the Prefect UI. Stay fresh ya'all!
    πŸš€ 6
    πŸ‘‹ 24
    :prefect-duck: 3
    :highfive: 2
    :marvin: 2
    j
    a
    +4
    • 7
    • 6
  • j

    Jon Chittenden

    10/07/2022, 1:47 PM
    :hattip: Hi friends, Happy Friday! I just joined Prefect as well as a Senior Security Engineer. I'll be building on the security program both within the product and Prefect as a company. Happy to also dig into any security concerns you all may have. Give me a shout!
    :party-parrot: 9
    πŸ‘‹πŸ½ 1
    πŸ™Œ 12
    :nod-intensifies: 2
    πŸ‘‹ 28
    🎊 2
    j
    a
    +2
    • 5
    • 4
  • g

    Gaurav Chadha

    10/17/2022, 7:48 PM
    Hi everyone, I'm Gaurav Chadha, a final-year student from India. I would love to contribute and learn more about Prefect projects with the community. Frontend and community engineering are my areas of interest. Here's my GitHub: https://github.com/Chadha93
    πŸ‘‹ 17
    :marvin: 2
    j
    c
    +7
    • 10
    • 10
  • a

    Adrienne Michelson

    10/18/2022, 4:30 PM
    Hello! I am Adrienne Michelson the Data Director of Vet Voice Foundation, a nonprofit with 1.5 million members. I am the first Data Director ever for the org and am looking to build workflows + automate away tasks. Prefect was recommended by our Data Consultant. I am an avid SQL and R user. I am working to improve my Python. Excited to learn more! My github is here:https://github.com/AdriMichelson
    πŸ’™ 2
    πŸ‘‹ 18
    a
    k
    +9
    • 12
    • 12
  • m

    Matthieu Lhonneux

    10/19/2022, 8:42 AM
    Hello, πŸ‘‹ I'm Matthieu, SRE Data on a French IT company. We have set up prefect to automatically manage our platforms (disk change, reboot, restart services...) I will be happy to discuss with you about the flows and the backend Happy to be here!
    πŸ‘‹ 19
    πŸ’ͺ🏽 1
    πŸ™Œ 5
    πŸ’ͺ 1
    a
    h
    +8
    • 11
    • 10
  • s

    Sunjay

    10/19/2022, 9:33 PM
    Hi folks, This is Sunjay here. Data Engineer from Statista( Based in Hamburg, Germany . Currently, migrating our flows from prefect 1.0 to 2.0 . Looking forward to exchange and learn through the awesome community over here.
    πŸ‘‹ 20
    :party-parrot: 3
    c
    j
    +8
    • 11
    • 13
  • b

    Bernie Lawson

    10/22/2022, 1:28 AM
    Hi! My name is Bernie - I work as a data engineer in the US (EST). I am exploring prefect to simplify some things I am working on and look forward to learning from everyone!
    πŸ™Œ 2
    πŸ‘‹ 18
    h
    c
    +7
    • 10
    • 11
  • p

    pk13055

    10/30/2022, 10:38 AM
    Hi folks! I'm Pratik, currently freelancing from the Middle East (GST) and working on some awesome finance products. Prefect has been an amazing transition from the archaic airflow setup we had. I am truly in awe of the almost 10x speed boost we've gotten in all our DAGs flows, not to mention with only 2 services instead of the 5/6 that Airflow requires.
    πŸ‘‹ 17
    πŸ™Œ 5
    h
    a
    +7
    • 10
    • 9
  • d

    Dzmitry Aliashkevich

    10/30/2022, 2:49 PM
    Hi everyone, I’m Dzmitry, work as Data Architect / Data Consultant for US based startups. Previously was a heavy Airflow user, but looking now into Prefect to improve pipelines testability, it’s going well so far, but from time to time facing tricky use cases which I glad to discuss.
    πŸ‘‹ 15
    l
    h
    +6
    • 9
    • 8
  • t

    Tim Galvin

    11/01/2022, 2:28 AM
    Hi all -- I am Tim and I work at CSIRO in Australia and I am looking at prefect as a way of coordinating some of our processing pipelines for our telescopes. Early days as I am trying to produce some examples from existing workflows run with other technologies.
    πŸ‘‹ 20
    πŸš€ 9
    πŸ”­ 6
    k
    a
    +9
    • 12
    • 11
  • s

    Santiago Toso

    11/02/2022, 2:16 PM
    πŸ‘‹ Hello, team! My name is Santiago and I work as a Data Scientist at Via. I started looking into prefect to automate some workflows that are causing trouble today. Please bear with me as I ask some beginner questions πŸ™‚
    :hattip: 3
    :marvin: 4
    πŸ‘‹ 22
    r
    c
    +8
    • 11
    • 13
Powered by Linen
Title
s

Santiago Toso

11/02/2022, 2:16 PM
πŸ‘‹ Hello, team! My name is Santiago and I work as a Data Scientist at Via. I started looking into prefect to automate some workflows that are causing trouble today. Please bear with me as I ask some beginner questions πŸ™‚
:hattip: 3
:marvin: 4
πŸ‘‹ 22
r

Ryan Peden

11/02/2022, 2:17 PM
Welcome, Santiago! We're happy you are here and we look forward to your questions. πŸ˜„
c

Chris Reuter

11/02/2022, 2:17 PM
Glad you are riding along with us @Santiago Toso!
s

Santiago Toso

11/02/2022, 2:19 PM
thank you! I'm having a great time following the tutorials for now. I was wondering if Prefect 2 also has the option of creating storage blocks from GitLab. I only see the GitLab option in the v1 documentation and not in the UI πŸ™‚
j

Jeff Hale

11/02/2022, 2:27 PM
Hi, @Santiago Toso! Welcome to the group! πŸš€
:thank-you: 1
b

Bianca Hoch

11/02/2022, 2:34 PM
Welcome @Santiago Toso! If you have any beginner questions, feel free to jump over to #prefect-getting-started . I'd recommend checking out our youtube videos and livestreams as well! πŸ™Œ
s

Santiago Toso

11/02/2022, 2:36 PM
thanks @Bianca Hoch, will do πŸ™‚ . I already posted the question in that channel. Let's see how it goes! 🀞
j

justabill

11/02/2022, 2:56 PM
πŸ‘‹ Hey @Santiago Toso, welcome!
πŸ‘‹ 1
a

Anna Geller

11/02/2022, 2:59 PM
bear with me
Welcome @Santiago Toso!
d

Dylan

11/02/2022, 3:05 PM
Welcome @Santiago Toso! πŸ‘‹
c

Christina Lopez

11/02/2022, 3:18 PM
Welcome to the chat @Santiago Toso πŸ‘‹πŸ½ happy to have you here!
πŸ‘‹ 1
m

Mason Menges

11/02/2022, 3:36 PM
Hey @Santiago Toso Great to have you in the community πŸš€
πŸ‘‹ 1
n

nathaniel

11/02/2022, 4:26 PM
πŸ‘‹ Hi @Santiago Toso, welcome!
πŸ‘‹ 1
View count: 5