👋 hi community! am here kicking the prefect tires on behalf of a digital services team in austin, tx, usa. i’ve got the server running with tasks in docker containers. so far so good 😅

Hi all. I'm Diego, currently doing some proof of concept using prefect in the logistics business.

Hi all, I'm Jay and am evaluating Prefect for orchestrating computational pipelines. Can someone please point me to documentation that outlines how Prefect writes the flow's state to some xml or json that can be inspected before, during, after the flow has been run/executed?

If a task/node fails, but the rest of the flow is still running- after some intervention, how do we restart that one failed task/node while the rest of the flow is still running?

Greetings all - I'm Keith, doing a POC on Prefect for use in my not-for-profit data company. Long time Airflow and Ni-Fi user, so interested to see what Prefect can bring!

Hi all, First time here, tried running prefect local server,,,( prefect server backend) followed every step of Getting started document ,UI server starts but i continuously fail to launch a local agent. Any hints around what could be possibly wrong.

Hi all, looking at getting a basic task to show up on the prefect UI (cloud ? maybe). Should I start an agent

prefect server start

and kick off my script?

Hello all, I am Azeem. Getting perfect in IT security. Master in Active Directory.

Hey everyone! Good to be joining this community. I'm a Software Engineer who is new to Prefect and data flows. I'm just getting started with the tool to see if it can fulfill my company's needs. Hope to learn as much as I can about Prefect and data workflows, and to collaborate in making the community grow 😄

Is there any dedicated channel to answer questions and problems for people getting started with Prefect?

Hello everyone, I'm evaluating Prefect for use in specialized CI systems. Our builds can take 30 minutes before the tests start running, so smart parallelization may be able to bring that number down.

Hi everyone! I’m a Senior Data Scientist in Singapore. Last year, I did a small project using Prefect for Covid-19 Spread Modeling. Now I’m looking to adopt Prefect for our Data Platform. I am looking forward to learning more and getting support from this awesome community 🙏

Hi Everyone, This is John, software developer in NJ.

Hi. I'm the CTO of MyOme, a small Bay Area genomics startup. I'm considering Prefect for genome sequence analysis and interpretation pipelines. If you have experience with that, I'd love to hear from you. (We're hiring!)

Hi everybody, I’m a software engineer at Recursion, we already use Prefect Core but we are considering using Prefect Cloud as part of our MLOps platform. Nice to meet you all. 👋

Hi everyone, I'm CEO/engineer at a Boston-based air quality sensor startup spun out of MIT. I've been a pretty big Luigi and Snakemake user in the past, but am looking at Prefect to re-work all of our data pipelines and MLOps.

Hi all, I’m the leader of the data engineering team over at Simplebet, a sports betting startup whose mission is to make every moment a bettable experience. Looking at prefect as a potential replacement after a disappointing upgrade to airflow 2.0.

Hi everyone, I'm a quantitative developer at a options portfolio management firm in Chicago, IL. I also work as a freelance algorithm dev on UpWork in my (little) spare time. I've lately taken it upon myself to revamp and modernize our dev ops workflow (VisualCron on Windows Server is a nightmare) and I came across Prefect in my quest 🙂

I am truly appreciative of what you guys are doing here. I've already converted a few workflows on my local to Prefect Cloud and it is a complete game changer!

Hey all! I’m the data engineer of Mentimeter, a Stockholm based interactive presentation tool. Super excited to be here as we’ve just decided to start testing Prefect for our growing orchestration needs. 👋

Hey everyone! I'm a Data Solution Architect with Databand.ai, a pipeline observability tool. I'm excited to collaborate with the burgeoning Prefect community by discussing pain points and promoting best practices within the data engineering space Psuccess kid

Hi all, I am a Senior Data Scientist at DRW.com. I have been using kedro for our projects and looking to integrate with Prefect to run and manage our pipelines. I also use Dask and now ray quite heavily. I will be looking into the source of Prefect. I saw Dask is used as an executor. I would love to try to add Ray (ray.io) as an executor.

Hi All! I'm the new lead of a recently born modeling area, we are part of the Integrated Risk Management office of the Bank. The organization doesn't have any team doing Data Science except for us (6 statistician + me, a developer). I had experience with DW and lots of different technologies but completely new to Data Science in general and the open source tooling around. I'm trying to pick the right stack for us and Prefect seems a great solution for Data Workflows!

Hello everyone. I'm the lead data scientist at Statsig.com. We build feature flag and experimentation tools for developers. We just integrated Prefect and it's been working great.

Hi, I am a senior data analyst from an Israeli startup Hexa3D, we are the world’s first 3D & Augmented Reality as a service platform. we're starting to examine prefect as our data workflow manager tool, going to use and contribute to this perfect community

Hi, I am a part of a brave team of UK startup UBIO😁. We help developers to drive API integration with websites when there is no API😳. It sounds magical and it's magical. We work with Google, Kayak and many more (Finance, Broadband, Travel). Will be happy to connect with you guys and find solution for our Dataflow automation

Hi all, I'm Jacopo from Coveo, in NYC. Sorry to bother, but I thought the news would be interesting for members of this community (esp. ML practitioners), especially if you need new shiny excuses to build new data pipelines on Prefect 😉 DATA CHALLENGE AT SIGIR 2021 Tired of models “validated” on the MovieLens dataset that don’t work in practice? We are proud to host the Data Challenge at SIGIR eCom 2021. Teams are invited to join the challenge and propose novel ML solutions for recommendation and intent prediction in eCommerce: for the occasion, we reveal a unique dataset, with fine-grained anonymized shopping events (>30M), enriched by linguistic behavior and catalog meta-data. May the best MRR/F1 win! IMPORTANT LINKS Challenge Sign-up: https://sigir-ecom.github.io/data-task.html  Github: https://github.com/coveooss/SIGIR-ecom-data-challenge Data Challenge Paper (draft): https://arxiv.org/abs/2104.09423

Hi everyone, I’m Rick from Exscientia, we’re in the middle of migrating a bunch of automations to Prefect Server and having great fun so far.

Hello my name is Todd I work for a relief agency that works with refugees all over the world and our end goal is to end war... I hope to get some help with prefect on a mac.

hey everyone, I'm Bill, and I'm just this guy, you know? (consultant at the moment, data scientist, finance quant on occasion, data management guy) I have some questions about the performance of prefect; trying to decide if I want to slip this in a stack or write an app for a moderate scale, but relatively low latency (human scale, that is) data capture. Feel free to slide in on my DMs, I'd love to get some insight on my question. Thanks!