One more question: is it possible to have different tasks in a pipeline run in separate containers? For instance, if one task needed to be run on a windows machine, and the next task in the flow needed to be run on a linux machine.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.