Daniel Ahn
03/04/2021, 10:38 PMupstream_tasks, it would cause the parent flow to run multiple times.
I think what I need is like the factory pattern in OO paradigm. In Airflow, I think I can use ExternalTaskSensor to achieve this.
- Does my question/use case make sense?
- Is there a preferred "Prefect" way to solve this?
- Or should I keep the state of the parent job externally?Zanie
Zanie
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by