Hi everyone, I came across Kedro (<https://github....
# show-us-what-you-got
c
Hi everyone, I came across Kedro (https://github.com/quantumblacklabs/kedro/). Does anyone have insight to how it compares to Prefect Core?
c
Hi @Carlos Gimenez - other people should chime in but two things that I’m aware of: - kedro doesn’t support scheduling / execution natively (so you’d most likely end up running your workflows on Airflow) - kedro’s API is declarative (Prefect supports a functional Pythonic API) - kedro will be a little more heavy when you are testing / experimenting (compare https://kedro.readthedocs.io/en/latest/02_getting_started/04_hello_world.html and https://kedro.readthedocs.io/en/latest/03_tutorial/04_create_pipelines.html with the hello world flow in Prefect’s README)
The first point is an important one; we’ve seen many other projects take this approach (ultimately relying on Airflow for scheduling / execution) — the Airflow scheduler is probably the most complained about piece of the Airflow monolith, so most of these projects are at least starting out inheriting these issues. For example, tasks can’t natively exchange data if the Airflow scheduler is responsible for their execution
c
This is great to know! Thank you so much for this insight!
c
anytime! If you have to do a deeper comparison, we’d love to hear about it
👍 1