Hi. I using prefect 2.2. I have a use case that lo...
# ask-communityd
Dylan McReynolds
08/30/2022, 5:25 PMHi. I using prefect 2.2. I have a use case that looks something like this:
• A data file has been created, I create a flow_run using the client API with the file path as a parameter
• At the end of the flow, if it has not errored, then I want more tasks to run, but I need it to wait for a particular interval (day, week)
I could do this with my own external scheduling system (that I have not written), but I would love to do that within prefect if possible. So my question…within a
flowt
Taylor Curran
08/30/2022, 7:07 PMYes Dylan, there are many ways this could be accomplished!
Taylor Curran
08/30/2022, 7:09 PMHave you checked out
prefect.clientTaylor Curran
08/30/2022, 7:09 PMIn which you can create a flow run from deployment.
Taylor Curran
08/30/2022, 7:10 PMThis is an example in which a flow can run inside of a flow.
d
Dylan McReynolds
08/30/2022, 7:14 PM@tc_prefect Yes, thanks. I’m using the Orion client to kick of the initial flows. However, I don’t see a way to schedule the flow_run to not start until, say, 1 day from now.
Dylan McReynolds
08/30/2022, 7:16 PMAnd I also don’t see a way to schedule a flow to launch a subflow…but not until 1 day from now. I suppose I could simply put a 24 hour pause in the parent flow, but it seems like I’d start backing up hundreds of flows a day.
t
Taylor Curran
08/30/2022, 7:18 PMI wonder if you create a new deployment with the desired schedule 24h+now?
d
Dylan McReynolds
08/30/2022, 7:20 PMHmmmm…but then I’d be creating hundreds of deployments a day…for the same flow
Dylan McReynolds
08/30/2022, 7:28 PMor maybe I misunderstood
t
Taylor Curran
08/30/2022, 7:36 PMI’m pretty sure we’ve set up deployments to handle complex scheduling like you’re describing. I’ve actually reached out to a colleague that might know more than me. We’ll get back to you later, sorry I couldn’t answer of the top of my head!
Taylor Curran
08/30/2022, 7:44 PMAnd do let us know if you’ve found something!
Taylor Curran
08/30/2022, 8:23 PMHi @Dylan McReynolds another person named @Dylan has come in clutch with a possible solution. Could you use the state argument in the create_flow_run()/from_deployment() method to set state=Scheduled(scheduled_time=now+24) something like:
Copy code
client.create_flow_run(state=Scheduled(scheduled_time={}))🙌 3
d
Dylan
08/30/2022, 8:26 PM
@Marvin open “Document Creating Scheduled Flow Run for Deployment”
❤️ 2
🔥 2
m
Marvin
08/30/2022, 8:27 PMd
Dylan McReynolds
08/30/2022, 10:11 PM@tc_prefect @Dylan this solution looks like it’s working for me!
t
Taylor Curran
08/30/2022, 11:50 PMYAYYY! panda dancing