https://prefect.io logo
Title
s

Samarth

05/16/2022, 9:50 AM
Hey all, this is Samarth. I am a journalist and programmer based in India. I recently started building Dateline, a data intelligence software that extracts signals from hard-to-access and noisy public data. At the moment, I am focused on building pipelines to collect high-frequency data from government and trusted private sources — that's the raw material for my product. Accuracy and speed of data acquisition are critical aspects of my offering, and it's challenging partly because I don't control the source data — and government release formats are often messy. That's why the workflow is critical to my product. Have been playing around with Prefect, reading docs, and writing small code snippets to test my understanding over the last ten days. And I love the possibilities. Excited to be part of this community and looking forward to learn from you all! 🙂
🥳 1
👋 13
a

Anna Geller

05/16/2022, 10:16 AM
Welcome to Prefect, @Samarth! This page will help get you started. Great to have you with us!
🎉 1
s

Samarth

05/16/2022, 10:27 AM
Thanks Anna. Great to meet you here. I binge-read your excellent Medium blog!
🙏 1
💯 1
h

Henning Holgersen

05/16/2022, 12:51 PM
Hi @Samarth, that sounds like a cool project.
:club42: 2
🙌 1
c

Chris Reuter

05/16/2022, 1:07 PM
Welcome to the community @Samarth! I'm sure you've seen @Ben Welsh's work - if not, very related: https://biglocalnews.org/posts/2022/04/14/prefect-live-scaling-scraping-with-gcp.html
🙌 1
k

Kevin Kho

05/16/2022, 1:26 PM
Hi @Samarth, welcome to Prefect!
🙌 1
j

jawnsy

05/16/2022, 2:03 PM
Welcome, @Samarth! 👋
🙌 1
s

Samarth

05/16/2022, 3:26 PM
@Chris Reuter Oh yes, I have seen Ben's work! :)
j

Joseph Desjardins

05/16/2022, 4:28 PM
Glad to have you in the Community @Samarth!
🙌 1
j

justabill

05/16/2022, 7:36 PM
👋 Hey @Samarth, welcome!
🙌 1