Ling Chen

    Ling Chen

    6 months ago
    Hello ! We have some memory intensive flows. These flows sometimes are triggered at the same time and executed through a LocalExecutor. The LocalExecutor will immediately launch all flow runs and cause memory errors. I wonder if there is a way to make LocalExecutor or any executor to execute one flow run at a time (sequentially) rather than launch all of flow runs at the same time?
    Kevin Kho

    Kevin Kho

    6 months ago
    Hi Ling, we have Flow Run Concurrency Limits for that
    Ling Chen

    Ling Chen

    6 months ago
    Is there a way to do that with custom server then? (We are using both cloud and custom server for different use cases).
    Kevin Kho

    Kevin Kho

    6 months ago
    This is not a Server feature for Prefect 1.0 but it is something 2.0 supports in the free version
    You have to do it in the state handler with the GraphQL API calls and then if you find that there is more than 1 flow in the running state, just use time.sleep()
    Ling Chen

    Ling Chen

    6 months ago
    I see! Good idea. Thanks! Looking forward to Prefect 2.0