Suresh R
01/27/2022, 6:17 PMKevin Kho
Suresh R
01/27/2022, 6:41 PMKevin Kho
Kevin Kho
Suresh R
01/27/2022, 6:47 PMcollate_monthly_lotame = LakeviewRunJobTask(cid=CID, job="europe-collate-monthly-lotame",
cluster=CLUSTER, poll_interval=300, name="collate-monthly-lotame", timeout=10800, result=S3_RESULT)
with Flow(FLOW_NAME) as flow:
arg_map = generate_arg_map(event_month)
t4 = collate_monthly_lotame.map(args=arg_map)
Suresh R
01/27/2022, 6:48 PMKevin Kho
arg_map
returns a listKevin Kho
Suresh R
01/27/2022, 6:51 PMSuresh R
01/27/2022, 7:04 PMKevin Kho
Suresh R
01/27/2022, 7:09 PMKevin Kho
Kevin Kho
Suresh R
01/27/2022, 7:25 PMSuresh R
01/27/2022, 7:25 PMSuresh R
01/27/2022, 7:28 PMKevin Kho
Suresh R
01/27/2022, 7:30 PMSuresh R
01/27/2022, 7:53 PM@task
def show(x):
print(x)
return(x)
with Flow(FLOW_NAME) as flow:
r=show.map(["A","B","C"])
s=show.map(["A","B","C"])
s.set_upstream(r)
In this case will s -mapA won't trigger if r -mapA fails?Suresh R
01/27/2022, 7:54 PMSuresh R
01/27/2022, 8:07 PMKevin Kho
s
to run with Triggers but you will run into other issues doing this because the assumption is they have the same number of elements