Hi everyone, I'm in the process to migrate from Prefect 1 to 2 and I have to say, at least for me, new Radar charts is more difficult to read then the original DAG view from version 1. I appreciate that there are cases when dependencies may not fit into DAG logic, but for all pipelines I run it makes more sense to see a flow from top to bottom. In a way it helps to:
• visualize the logic (raw data, clean data, model calibration, generate reports)
• check whether your decency code is doing what you want it to do
I have to say that using Prefect instead of Airflow for my new company was partly driven by much more straight forward UI. So the question is really whether there is a plan to add an option to visualize a flow in a tree like graph?
01/03/2023, 1:03 PM
Hi Kirill. Thank you for the feedback. A flow run predictive DAG view is in the works. 🙂
01/03/2023, 1:03 PM
01/05/2023, 7:39 PM
Chiming in here to throw these two charts in as the most useful from 1. We’re currently evaluating migration from Airflow to Prefect (I have a lot of experience with Prefect 1). I believe the individual flow run shouldn’t matter if there is a DAG or not, but I could be mistaken. It’s just tasks, when they ran, and how long they took.
gratitude thank you 1
01/05/2023, 8:39 PM
@Sam Werbalowsky to you comment I have to follow ups:
• Prefect 1 from Airflow is now brainer migration. I have done both I can tell you that you can move to Prefect 1 without questions
• I have more issues moving from Prefect 1 to Prefect 2. The chart what I use all the time is Schematic. For your example it may not be an issue, but when you partition you compute to manage single point of failure risk plus has more complex downstream dependency Radar chart is very confusing vs the chart from Prefect 1.
Here is more complex DAG chart I'm talking about. You can tell from it very quickly at what stage there is a problem how many tasks have failed on that stage. You can get anything close to that on Prefect 2
01/05/2023, 8:54 PM
Yeah - I see what you mean - I 100% agree about moving to prefect 1 from Airflow, and have done that at a prior job…it’s a pretty intuitive move if you have the resources.
The visuals in 2 do not seem to be as advanced, whether before or after the flow run.