Hey all, this is Samarth. I am a journalist and programmer based in India. I recently started building Dateline, a data intelligence software that extracts signals from hard-to-access and noisy public data. At the moment, I am focused on building pipelines to collect high-frequency data from government and trusted private sources — that's the raw material for my product. Accuracy and speed of data acquisition are critical aspects of my offering, and it's challenging partly because I don't control the source data — and government release formats are often messy. That's why the workflow is critical to my product. Have been playing around with Prefect, reading docs, and writing small code snippets to test my understanding over the last ten days. And I love the possibilities. Excited to be part of this community and looking forward to learn from you all! 🙂

Welcome to Prefect, @Samarth! This page will help get you started. Great to have you with us!

Thanks Anna. Great to meet you here. I binge-read your excellent Medium blog!

Hi @Samarth, that sounds like a cool project.

Welcome to the community @Samarth! I'm sure you've seen @Ben Welsh's work - if not, very related: https://biglocalnews.org/posts/2022/04/14/prefect-live-scaling-scraping-with-gcp.html

Hi @Samarth, welcome to Prefect!

Welcome, @Samarth! 👋

@Chris Reuter Oh yes, I have seen Ben's work! :)

Glad to have you in the Community @Samarth!

👋 Hey @Samarth, welcome!