Jacques04/27/2020, 2:25 PM
for the mapped function, but it only works for unmapped tasks
Kyle Moon-Wright04/27/2020, 3:29 PM
task but one of the mapped tasks fails, the reducing task’s trigger will fail. Note that triggers are only applied on the children tasks, not the parent.
Jacques04/27/2020, 4:41 PM
Kyle Moon-Wright04/27/2020, 5:07 PM
Jacques04/27/2020, 6:12 PM
But if I make ExtractDummyTask raise a RuntimeError() then TransformDummyTask tries to run using the RuntimeError - this error specifically
extract_dummy = ExtractDummyTask(trigger=all_successful) transform_dummy = TransformDummyTask(trigger=all_successful) load_dummy = LoadDummyTask(trigger=all_successful) # Create dummy flow with Flow("dummy_flow") as flow: # Extract values = extract_dummy() # Transform transformed_values = transform_dummy.map(data=values) # Load load_dummy(data=transformed_values)
Task 'TransformDummyTask': unexpected error while running task: TypeError("Cannot map over unsubscriptable object of type <class 'RuntimeError'>: RuntimeErr...")
Task 'LoadDummyTask': finished task run for task with final state: 'TriggerFailed'
Kyle Moon-Wright04/27/2020, 6:40 PM
Jacques04/27/2020, 6:50 PM
Kyle Moon-Wright04/27/2020, 7:23 PM
Jacques04/27/2020, 8:26 PM
Kyle Moon-Wright04/27/2020, 8:51 PM