Thread
#prefect-community
    Tony Yun

    Tony Yun

    11 months ago
    Hi, is there a way to make schedule to run one after one? like, if the first job didn’t finish, the second one has to wait.
    Kevin Kho

    Kevin Kho

    11 months ago
    Hey @Tony Yun, are these for the same flow?
    Tony Yun

    Tony Yun

    11 months ago
    yes
    Kevin Kho

    Kevin Kho

    11 months ago
    Maybe you can use flow run concurrency ?
    Tony Yun

    Tony Yun

    11 months ago
    ah I see. Sounds good to me. Thanks!
    hold on, is there a way to trigger the job to run after it finishes a certain amount of time? that not on a fixed schedule
    Kevin Kho

    Kevin Kho

    11 months ago
    It would have to be through the state handler of the currently running flow to kick of a new flow run through
    create_flow_run
    or
    StartFlowRun
    . What is the use case you are trying to achieve? Maybe it can be done with automations also
    Tony Yun

    Tony Yun

    11 months ago
    we have a dbt job that is time consuming and can’t run in parallel. however the time spent is inconsistent so can’t use fixed schedule either..
    Kevin Kho

    Kevin Kho

    11 months ago
    What do you want to run after the dbt job?
    Tony Yun

    Tony Yun

    11 months ago
    the same dbt job
    like to run it repeatedily
    Kevin Kho

    Kevin Kho

    11 months ago
    Ah in this case, you want to just have a flow level state handler that creates a new flow run upon completion
    Hey I take that back, what you should do is use flow concurrency of 1, and then if the flow run is too late, use an automation to cancel it
    so that it will just continue from the next next schedule you know?
    I think an ELT architecture might help you more than ETL btw if you need to be running dbt constantly
    This article by the Airbyte CEO is pretty good
    Tony Yun

    Tony Yun

    11 months ago
    Thank you for this much information! I’ll take a look around.