Marcin Grzybowski
05/31/2022, 3:56 PMRuntimeError("The task runner is already started!")
Modified code below:
import asyncio
from prefect import flow
@flow
async def subflow_1():
print("Subflow 1 started!")
await asyncio.sleep(1)
@flow
async def main_flow():
parallel_subflows = [subflow_1(), subflow_1()]
await asyncio.gather(*parallel_subflows)
if __name__ == "__main__":
main_flow_state = asyncio.run(main_flow())
Anna Geller
05/31/2022, 5:25 PMMarcin Grzybowski
05/31/2022, 5:27 PMAnna Geller
05/31/2022, 5:32 PMMarcin Grzybowski
05/31/2022, 5:36 PMAnna Geller
05/31/2022, 6:49 PMimport asyncio
from prefect import flow
@flow
async def subflow_1():
print("Subflow 1 started!")
await asyncio.sleep(1)
@flow
async def main_flow():
for _ in range(5):
await subflow_1()
if __name__ == "__main__":
main_flow_state = asyncio.run(main_flow())
Marvin
05/31/2022, 6:52 PMMarcin Grzybowski
05/31/2022, 7:21 PMimport asyncio
import copy
from prefect import flow
@flow
async def subflow_1(a):
print("Subflow 1 started!" + a)
await asyncio.sleep(1)
@flow
async def main_flow():
parallel_subflows = [subflow_1('a'), copy.deepcopy(subflow_1)('b')]
await asyncio.gather(*parallel_subflows)
if __name__ == "__main__":
main_flow_state = asyncio.run(main_flow())
21:11:23.753 | INFO | prefect.engine - Created flow run 'lyrical-beluga' for flow 'main-flow'
21:11:23.757 | INFO | Flow run 'lyrical-beluga' - Using task runner 'ConcurrentTaskRunner'
21:11:23.796 | WARNING | Flow run 'lyrical-beluga' - No default storage is configured on the server. Results from this flow run will be stored in a temporary directory in its runtime environment.
21:11:24.077 | INFO | Flow run 'lyrical-beluga' - Created subflow run 'steadfast-waxbill' for flow 'subflow-1'
Subflow 1 started!a
21:11:24.279 | INFO | Flow run 'lyrical-beluga' - Created subflow run 'venomous-ibex' for flow 'subflow-1'
Subflow 1 started!b
21:11:25.223 | INFO | Flow run 'steadfast-waxbill' - Finished in state Completed()
21:11:25.409 | INFO | Flow run 'venomous-ibex' - Finished in state Completed()
21:11:25.450 | INFO | Flow run 'lyrical-beluga' - Finished in state Completed('All states completed.')
Anna Geller
05/31/2022, 7:54 PMMarcin Grzybowski
06/01/2022, 8:32 AM