Tom Kaszemacher
08/02/2022, 10:02 PM@task()
def get_inputs() -> List:
# This task retrieves a list of inputs to process from a DB and returns it
pass
with Flow(name='dispatcher') as dispatcher:
inputs = get_inputs()
for i in inputs:
create_flow_run('worker', parameters={'input': i})
It doesn’t work as I need to provide either nouts or return a Tuple in order to iterate over my inputs, however I don’t know the size of it.
What would be a correct approach here?
Thanks!Mason Menges
08/02/2022, 10:23 PMTom Kaszemacher
08/02/2022, 10:57 PMMason Menges
08/02/2022, 10:58 PMNate
08/03/2022, 1:10 AMprefect>=2.0.0
!
for example:
from prefect import task, flow
from typing import Any, List
@flow
def my_subflow(subflow_input: Any):
print('interesting tasks being called!')
@task()
def get_inputs() -> List:
print('gathering inputs...')
return []
@flow
def my_flow(inputs: Any = None):
inputs = inputs if inputs else get_inputs()
for i in inputs:
my_subflow(subflow_input=i)
Tom Kaszemacher
08/05/2022, 1:26 PM