Also very exited about Orion π, I am wondering if there is an example/documentation on generate new tasks or entire workflows in response to streaming events?
β€οΈ 3
d
davzucky
10/06/2021, 1:20 AM
Yes I have same question. Could a task be a generator now. This would be nice for messaging system base
π 1
c
Chris White
10/06/2021, 3:28 AM
While we donβt have any off the shelf examples to share at this moment, I highly encourage you to try writing a flow or two yourself in whatever way feels most intuitive to you β because no static registration step is required for flows or tasks, I think you will be surprised at what you can do.
For example, start with a script and enclose the entire body of logic in a flow function to get started - this function can be dynamically generated, with dynamic name, version and tags that change with each event (if that fits your use case). Then refactor one or two function to tasks, etc and watch how the data in the UI changes each time.
Whenever you have something that makes sense to you, feel free to share it for feedback!
π 1
g
Gaylord Cherencey
10/06/2021, 8:31 PM
Thank you @Chris White for your answer, what I am not entirely sure how to link for example an Kafka event with the execution of flow. Do I still need a lambda to control the triggering of it?
c
Chris White
10/06/2021, 8:56 PM
gotcha gotcha, yea right now you'd need a lambda or a long running consumer process somewhere, there are no native streaming hooks right now
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.