Philip MacMenamin
04/19/2022, 7:41 PMupstream_tasks
on a ShellTask
This works:
brt_commands = create_brt_command.map(adoc_fp=updated_adocs)
brt_commands_logged = log(item=brt_commands, desc="BRT commands")
brts = shell_task.map(
command=brt_commands, upstream_tasks=[tomogram_fps]
)
This fails:
brt_commands = create_brt_command.map(adoc_fp=updated_adocs)
brt_commands_logged = log(item=brt_commands, desc="BRT commands")
brts = shell_task.map(
command=brt_commands, upstream_tasks=[tomogram_fps, brt_commands_logged]
)
Kyle McChesney
04/19/2022, 7:47 PMunmapped(tomogram_fps)
to the upstream_task. Its kind of an interesting edge case between .map
and upstream_tasks
Nate
04/19/2022, 7:50 PMPhilip MacMenamin
04/19/2022, 7:50 PM[2022-04-19 12:56:09-0600] INFO - prefect.TaskRunner | Task 'create_brt_command[0]': Starting task run...
[2022-04-19 12:56:09-0600] INFO - prefect.TaskRunner | Task 'create_brt_command[0]': Finished task run for task with final state: 'Success'
[2022-04-19 12:56:10-0600] INFO - prefect.TaskRunner | Task 'log': Starting task run...
[2022-04-19 12:56:10-0600] INFO - prefect.log | BRT commands : ['/opt/rml/imod/bin/batchruntomo -di /gs1/home/macmenaminpe/tmp/tmpovrvi7nb/dirTemplate.adoc -cp 8 -gpu 1']
[2022-04-19 12:56:10-0600] INFO - prefect.TaskRunner | Task 'log': Finished task run for task with final state: 'Success'
[2022-04-19 12:56:10-0600] INFO - prefect.TaskRunner | Task 'ShellTask': Starting task run...
[2022-04-19 12:56:10-0600] INFO - prefect.TaskRunner | Task 'ShellTask': Finished task run for task with final state: 'Failed'
[2022-04-19 12:56:10-0600] INFO - prefect.TaskRunner | Task 'log': Starting task run...
[2022-04-19 12:56:10-0600] INFO - prefect.log | updated Adoc files : [PosixPath('/gs1/home/macmenaminpe/tmp/tmpovrvi7nb/dirTemplate.adoc')]
[2022-04-19 12:56:10-0600] INFO - prefect.TaskRunner | Task 'log': Finished task run for task with final state: 'Success'
[2022-04-19 12:56:10-0600] INFO - prefect.FlowRunner | Flow run FAILED: some reference tasks failed.
unmapped()
stuff in the upstream_tasks is interesting. I think I have to get my head around that for a second.Kyle McChesney
04/19/2022, 7:54 PMPhilip MacMenamin
04/19/2022, 7:54 PMNate
04/19/2022, 7:54 PMKyle McChesney
04/19/2022, 7:55 PMupstream_tasks=[unmnapped(tomogram_fps), unmapped(brt_commands_logged)]
?Philip MacMenamin
04/19/2022, 7:56 PMKevin Kho
04/19/2022, 7:59 PMmapped_task = task_one.map(.., upstream_tasks=[unmnapped(tomogram_fps), unmapped(brt_commands_logged)])
should work if tomogram_fps
and brt_commands_logged
are not mapped tasksPhilip MacMenamin
04/19/2022, 8:01 PMDan Morris
04/25/2022, 8:35 PM