Hey Everyone, Quick Questions, I've been using pr...
# data-tricks-and-tips
d
Hey Everyone, Quick Questions, I've been using prefect for a little bit of time, with cron scheduling. I would like to know if someone knows if Prefect has the possibility to do something like : run every 10min until the flow succeed Basically i have a flow that scrap some data that is updated between 10 and 12am, I Could update my script and set a check at the beginning of the script that if data is received stop the script. But it's not optimal imo as it will still run the code 10times + for nothing as i already have the data. Thanks !!! Dan
r
you could schedule the flow to run once then if it doesn't succeed run the deployment again in 10 mins using https://docs.prefect.io/2.10.17/api-ref/prefect/deployments/deployments/#prefect.deployments.deployments.run_deployment
t
I would uses a task with infinite retries and a 10min wait between retries: https://docs.prefect.io/2.10.17/concepts/tasks/#retries