Hi everyone! Is it possible to remove some tasks v...
# ask-communityg
Giacomo Chiarella
11/30/2023, 9:45 AMHi everyone! Is it possible to remove some tasks visualised in the DAG graph? Or otherwise hide some tasks? What I would like to is to extract a sub DAG basically. An alternative which would work would also be to aggregate some tasks in one task. Unfortunately, via code I cannot because I cannot run tasks from within another task (or at least I don’t know how given that I’ve got an error says I cannot run a tasks from within another task)
m
Mattijs De Paepe
11/30/2023, 9:53 AMHave you tried subflows?
g
Giacomo Chiarella
11/30/2023, 9:54 AMdo you have any example?
m
Mattijs De Paepe
11/30/2023, 9:54 AMg
Giacomo Chiarella
11/30/2023, 9:55 AMI will check it, thanks!
Giacomo Chiarella
11/30/2023, 10:09 AM@Mattijs De Paepe looks promising. There is one thing I do not see in the doc which is how to make a subflow wait for another one to finish. For the tasks we can use
.submit(wait_for=[task1, task2])m
Mattijs De Paepe
11/30/2023, 10:23 AM“Subflows will block execution of the parent flow until completion. However, asynchronous subflows can be run in parallel by using AnyIO task groups or asyncio.gather.”
g
Giacomo Chiarella
11/30/2023, 10:43 AMI think that could work. Do you have any example about running subflows in parallel?
m
Mattijs De Paepe
11/30/2023, 10:46 AMNo sorry
👍 1