Jan Domanski
05/08/2022, 1:30 PM@task
def generate_numbers():
return [1, 2, 3, 4]
@task
def compute_sth_expensive(number):
return number ** 2
@flow
def pipeline():
result_generate_numbers = generate_numbers()
results = map(compute_sth_expensive, result_generate_numbers)
for r in results: r.result() ## ??
Is that an acceptable pattern? I want to do a parallel calculation over the result_generate_numbers
and then perform some gather-like operationAnna Geller
Jan Domanski
05/08/2022, 1:59 PMAnna Geller
Jan Domanski
05/08/2022, 2:06 PMAnna Geller
.result()
Jan Domanski
05/08/2022, 2:15 PM