question: in kubernetes, kafka consumer launching pipelines using celery executors with task saying "hello world" should be almost immediate right? no spinning up of new containers. why does it take several seconds to spin up a pipeline that does nothing? what's your experience to bring it near real time?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
