Hey Priya,
It’s great you’re considering Prefect for your workflow solution, welcome! I’ll try to answer your questions as best I can:
1. Although we don’t recommend migrating production level DAGs to Prefect as a POC, we’ve consistently heard that Airflow PoCs can take weeks while Prefect PoCs take days! I’d recommend reading the following articles to get a feel for how they compare:
https://medium.com/the-prefect-blog/why-not-airflow-4cfa423299c4
https://docs.prefect.io/core/advanced_tutorials/task-guide.html
2. The Prefect Scheduler does not schedule individual tasks only flows, therefore the speed at which tasks can execute depends on the executor you use. For example, if you run your Flow on Dask, you can expect millisecond latency in between your task runs. In another aspect, the Prefect UI is essentially live updating.
3. Core users who require state management historically used Cloud, but as of this week they can leverage our newly open sourced backend! Another option we’ve seen is a completely custom solution using state handlers. Check out the documentation on state handlers here:
https://docs.prefect.io/core/concepts/states.html#state-types
4. On our YT channel you’ll find some recently posted videos including a tour of our Cloud UI, a demo of our recently released Open Source UI, and a livestream recording that took place today! Much more content will be posted in the coming weeks in lieu of the conference talks we had planned. The channel can be found here:
https://www.youtube.com/channel/UCMPaCpAiSuLZ0yPyUo0O9rw/featured (edited)
I hope this helps, happy building!