gperrone
01/11/2024, 12:50 AMgperrone
01/11/2024, 12:54 AMgperrone
01/11/2024, 12:55 AMgperrone
01/11/2024, 1:00 AMNate
01/11/2024, 4:22 AMRobin Niel
01/11/2024, 8:21 AMNate
01/11/2024, 11:59 AMrun_deployment
to run deployments as subflows (which you can call from within a task) and map those, which would end up near parallelRobin Niel
01/11/2024, 1:18 PMNate
01/11/2024, 1:45 PMmy_task.submit()
or my_task.map()
and get concurrent (ConcurrentTaskRunner
by default) or actual parallel (Dask / Ray task runners) execution without having the submission of the task be blocking (tasks are sent to their own threads)
subflows, however are currently blocking (stay on the main thread, for now), even if gathered async. again the one exception, is that you can write a task that you can submit which calls run_deployment and therefore will track the invoked deployment as a subflow of the callergperrone
01/11/2024, 3:58 PMgperrone
01/11/2024, 3:59 PM.submit()
sort of pattern going for subflows though!