Hey
@Maryam Veisi!! I would recommend checking out t
his discourse post (the syntax is a bit outdated but the pattern is still valid). The orchestrator worker patter will allow you to create subflows for your 3 processes and keep track of them within the parent flow. As for memory, Prefect has a KubernetesJob block that is helpful in defining specs for pods running Prefect flows. Depending on your infrastrucute, different blocks have different configurations for memory that could be useful for you use case. You can also use the ConcurrentTaskRunner or the DaskTaskRunner (
see docs here) for either concurrently running tasks or parallelizing them.