Lauri Makinen
08/05/2021, 6:09 PMextract_flow_task = StartFlowRun(flow_name=extract_flow.name, wait=True, project_name=PROJECT_NAME)
transform_flow_task = StartFlowRun(flow_name=transform_flow.name, wait=True, project_name=PROJECT_NAME)
#
# Parent flow, executed on Kubernetes agent
#
with Flow("parent_flow", storage=storage, run_config=KubernetesRun(labels=["kubernetes"])) as parent_flow:
date_YYYYmmdd = Parameter("date_YYYYmmdd")
extract_task = extract_flow_task() # How to pass date_YYYYmmdd to this flow/task?
transform_flow_task(upstream_tasks=[extract_task]) # How to pass date_YYYYmmdd to this flow/task?
Kevin Kho
StartFlowRun
takes an argument called parameters
so it can be transform_flow_task(upstream_tasks=[extract_task], parameters={"param_name", dateYYYmmdd})
Lauri Makinen
08/05/2021, 6:12 PM