Hey team, I have a big websocket stream. And i want to run flow with this stream data. I think i can use dask or ray to process for this big data. But i’m not sure what is the best practices. I want to autoscale my processes. What do you think about it?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.