Samuel Hinton
12/06/2024, 12:50 AM@flow
def parent_flow(start: dt, end: dt):
for date in get_dates(start, end):
memory_intensive_flow(date)
But I want to make sure that these subflows are distributed over all the workers and not just scheduled on the worker the parent flow is executing in. I'm not sure how to quickly write a dummy flow and figure out which worker replica its executed on, so I thought I'd check and see if anyone knew the answer off hand.