Good morning Prefect Team!
So my usage case is:
- On the upstream processing
- We have multiple jobs that could be running in parallel (each with a unique job id)
- Each job have a fixed number of sub tasks that all runs in async, I have configured the tasks to emit a prefect event with job id as payload on completion.
- I want to run a “collection” prefect deployment with job id as a param when all sub tasks of that job have completed.
When I’m search around I think
CompoundTrigger
is the closest tool for this kind of patten but I couldn’t find any examples around, does anyone ever use such pattern before?
Thank you!