https://prefect.io logo
d

Dan Cabrol

06/28/2023, 4:18 PM
Hey Everyone, Quick Questions, I've been using prefect for a little bit of time, with cron scheduling. I would like to know if someone knows if Prefect has the possibility to do something like : run every 10min until the flow succeed Basically i have a flow that scrap some data that is updated between 10 and 12am, I Could update my script and set a check at the beginning of the script that if data is received stop the script. But it's not optimal imo as it will still run the code 10times + for nothing as i already have the data. Thanks !!! Dan
r

redsquare

06/29/2023, 6:42 AM
you could schedule the flow to run once then if it doesn't succeed run the deployment again in 10 mins using https://docs.prefect.io/2.10.17/api-ref/prefect/deployments/deployments/#prefect.deployments.deployments.run_deployment
t

Thomas Wickham

06/29/2023, 7:50 AM
I would uses a task with infinite retries and a 10min wait between retries: https://docs.prefect.io/2.10.17/concepts/tasks/#retries