How to handle heavy computations in flow runs? @Marvin

For handling heavy computations in flow runs, you can consider the following: - Use asynchronous tasks: Prefect supports asynchronous tasks, which can be useful for IO-bound tasks or tasks that involve heavy computations. This allows the task to release the GIL and let other tasks continue their execution. Here's an example:

@flow(persist_result=True)
async def foo():
    return 42

@flow(persist_result=True)
async def longrunning():
    res = 0
    for ii in range(20):
        time.sleep(5)
        res += (await foo())
    return res

- Pausing flow runs: By default, pausing a flow run blocks the worker — the flow is still running inside the pause_flow_run function. However, you may pause any flow run in this fashion, including non-deployment local flow runs. Please note that the above information is based on the Prefect documentation and community resources. For more specific advice, you may want to provide more details about your use case or consult the Prefect community or documentation directly. Source