Hi everyone, I'm new to Prefect and stumbled upon it after using Airflow for my current project and feeling dissatisfied. I am creating workflows to do production data monitoring/ business rule checking and alerting on big data. Has anyone else used Prefect for a similar problem and could share feedback or advice? Thank you!
10/31/2019, 2:43 PM
Aliza, my use case is different, but I needed ability to trigger workflow runs via an API (in addition to scheduled runs), and to pass in parameters and have the workflow behave differently based on the parameter values. I could not accomplish either of these things in Airflow, but they have first-class support in Prefect.
Also, Prefect embraces python to the fullest, so I was able to handle all my edge cases
Finally, the learning curve for new people on my team is easier. We started with prefect core and gradually moved to prefect cloud and scalability
10/31/2019, 3:54 PM
@Adam Roderick thank you for your response! Your use case is related to some of what I'm trying to accomplish - namely re-running the same workflow with different parameter values. Where did you look for examples? Did you use any other resources besides the Prefect docs?
10/31/2019, 3:58 PM
The Prefect docs first, especially the suite of examples they have. The Prefect team here on slack is super responsive. The docs do have some gaps so it took some hands on experience, but every time I hit a wall the Prefect team held my hand