sbrabez
06/26/2023, 5:35 PM2.9.0
version. So far we run more than 100k flows and tasks and we monitor through Grafana our SLOs regarding tasks/flows failures. It used as a massive Scheduler for us and we push to use it even more nowadays for diverse data operations. Some figures as today:
• Started to implement Prefect 1.0 in April 2022
• Migrated to Prefect 2.0 in Nov 2022 and did several versions upgrade (~10) up to current version 2.9.0
• Used it for our internals workflows and as backend scheduler
• Total Flow runs 105 997 reported by the DB with SELECT count(*) FROM flow_run;
• Total Task runs 272 308 reported by the DB with SELECT count(*) FROM task_run;
• 15 deployment and 10 different work-queue
• 4 Clusters
• Some Failures 🙂 and even more of Success 👏
We adopted it because it’s Python based and the learning curve is very slight. Also the dynamics around the project are extremely positives. Happy Positive Engineering 🙂
Just wanted to give you a feedback and Thanks for this workflow framework 🤝Dylan
Chris Reuter
06/26/2023, 5:39 PMBrian Russell
06/26/2023, 6:03 PMJeff Hale
06/26/2023, 6:19 PMBianca Hoch
06/27/2023, 1:26 PMjustabill
Aimee McManus
06/27/2023, 5:31 PM