Kevin Weiler01/04/2023, 10:22 PM
method from the
class. I don’t think the new API has this. Is there a way to iteratively add tasks to a flow?
Mason Menges01/04/2023, 11:05 PM
Kevin Weiler01/05/2023, 2:29 AM
- it’s a lot like
) and polls the api until the job either times out, fails, or completes successfully. I load these yaml files into a single dictionary, loop through them once to add them to a flow, and then loop through them again to set dependencies. What I’m left with is a single flow with a few different subtrees. I then register the flow with the prefect api and run them on a schedule.