Hi, is there a way to make schedule to run one aft...
# ask-communityt
Tony Yun
10/12/2021, 4:08 PMHi, is there a way to make schedule to run one after one? like, if the first job didn’t finish, the second one has to wait.
k
Kevin Kho
10/12/2021, 4:11 PM
Hey @Tony Yun, are these for the same flow?
t
Tony Yun
10/12/2021, 4:11 PMyes
k
Kevin Kho
10/12/2021, 4:14 PM
Maybe you can use flow run concurrency ?
t
Tony Yun
10/12/2021, 4:15 PMah I see. Sounds good to me. Thanks!
Tony Yun
10/12/2021, 4:16 PMhold on, is there a way to trigger the job to run after it finishes a certain amount of time? that not on a fixed schedule
k
Kevin Kho
10/12/2021, 4:18 PM
It would have to be through the state handler of the currently running flow to kick of a new flow run through
create_flow_runStartFlowRunt
Tony Yun
10/12/2021, 4:20 PMwe have a dbt job that is time consuming and can’t run in parallel. however the time spent is inconsistent so can’t use fixed schedule either..
k
Kevin Kho
10/12/2021, 4:23 PM
What do you want to run after the dbt job?
t
Tony Yun
10/12/2021, 4:23 PMthe same dbt job
Tony Yun
10/12/2021, 4:23 PMlike to run it repeatedily
k
Kevin Kho
10/12/2021, 4:31 PM
Ah in this case, you want to just have a flow level state handler that creates a new flow run upon completion
upvote 1
Kevin Kho
10/12/2021, 5:17 PM
Hey I take that back, what you should do is use flow concurrency of 1, and then if the flow run is too late, use an automation to cancel it
👍 1
Kevin Kho
10/12/2021, 5:18 PM
so that it will just continue from the next next schedule you know?
Kevin Kho
10/12/2021, 5:25 PM
I think an ELT architecture might help you more than ETL btw if you need to be running dbt constantly
Kevin Kho
10/12/2021, 5:27 PM
This article by the Airbyte CEO is pretty good
t
Tony Yun
10/12/2021, 5:28 PMThank you for this much information! I’ll take a look around.
5 Views