https://prefect.io logo
k

Konstantinos

10/01/2020, 4:04 PM
Hi, I 'd like to ask some help/advice on setting up dependent flows. A simplified example of my set up is: I have a flow that ingests some data through a couple of tasks, lets call it flow1. I have another task that I'd like to run from a different flow, call it flow2. The catch is that there will be many such data-ingestion (flow1) dependent tasks. How can i make flow2 have its own schedule but only kick off once flow1 is completed ? I find the solution of making all tasks belonging to one big flow (and setting dependencies there) unsatisfactory as this will grow a lot in the medium term. Thank you in advance for any pointers!
n

nicholas

10/01/2020, 7:10 PM
Hi @Konstantinos - I think the most straightforward way to handle this is to add a task to the top of flow2 that checks for whatever condition you need from flow1 to be met, and skips the run if it isn't. You can then run flow2 on a schedule without worrying that it'll run when it shouldn't
k

Konstantinos

10/02/2020, 8:03 AM
Hello @nicholas that's interesting, i will try it out. Is there any example like this in the docs where one task check a condition on another ?