Hi, just wondering here about the possibility of prefect to develop a visual pipeline builder like aws step functions or orchest? Are you planning on this or let the community do it?
j
Jeremiah
10/16/2021, 2:33 PM
Hi @Chu Lục Ninh, while we have not committed to building something like that yet, we did keep it in mind when designing the Orion engine to make it easier to do once the engine API is stable. I think we’ll have more to discuss next year.
🔥 3
👀 2
c
Chu Lục Ninh
10/16/2021, 2:45 PM
Yes, I believe we can decouple "task" even more from "flow". Flow can be scheduled & orchestrate via visual editor, while we keep the implementation of tasks in our code. That will be much better for modular & reuse.
j
Jeremiah
10/16/2021, 2:46 PM
I agree, that’s the right way to ease into this feature
c
Chu Lục Ninh
10/16/2021, 8:51 PM
Yup, for the performance & live-update part, I think we can borrow event sourcing technique to make it nicely. From my experience reading through datahub project.