Kevin Weiler
01/04/2023, 10:22 PMadd_task
method from the flow
class. I don’t think the new API has this. Is there a way to iteratively add tasks to a flow?Mason Menges
01/04/2023, 11:05 PMKevin Weiler
01/05/2023, 2:29 AMnomad
- it’s a lot like kubernetes
) and polls the api until the job either times out, fails, or completes successfully.
I load these yaml files into a single dictionary, loop through them once to add them to a flow, and then loop through them again to set dependencies. What I’m left with is a single flow with a few different subtrees. I then register the flow with the prefect api and run them on a schedule.