Hello Folks.
Question. I have a flow defined with several task using "map"
I want to run a final task once all map tasks have finished. This is my code:
Copy code
with Flow(
FLOW_NAME,
run_config=UniversalRun(labels=LABELS),
terminal_state_handler=workflow_terminal_state_handler,
) as flow:
file_list = list_unprocessed_files(var)
dataframes = get_dataframes.map(file_list)
dataframes = filter_dataframe.map(
dataframes, resource_type_name=unmapped(var)
)
# this is the final task
print_process_summary_log()
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.