https://prefect.io logo
Title
v

Venkat Ramakrishnan

09/01/2022, 5:31 PM
Does anyone know of a bug where even though the frequency of the schedule is once in an hour, multiple runs are created for that hour? The flows keep increasing every minute. I now have 5 runs for the same hour! Here is my deployment code:
deployment = Deployment.build_from_flow(flow=print_pipeline_hour,\
                                        name="Hourly Pipeline Deployment", version="1", tags=["Iris"],\
                                        schedule={'rrule': 'FREQ=HOURLY;UNTIL=20220912T040000Z', 'timezone': "Asia/Kolkata"},
                                        work_queue_name="hour-work-queue")
1
j

Jeff Hale

09/02/2022, 1:22 AM
Strange. If you delete that deployment and create it again from the file so you get five runs one minute apart again? If so, I would open a big report issue at prefect/prefecthq.
Also, could you please move the scheduled flow output from the main slack channel to this thread to help keep the main channel tidy?
1
v

Venkat Ramakrishnan

09/02/2022, 2:07 AM
Here are the runs scheduled: print-pipeline-hour / strange-hippo Scheduled 0s Scheduled for 2022/09/01 11:31:56 PM auto-scheduledIris print-pipeline-hour / fanatic-swallow Scheduled 0s Scheduled for 2022/09/01 11:30:56 PM auto-scheduledIris print-pipeline-hour / stirring-sparrow Scheduled 0s Scheduled for 2022/09/01 11:29:56 PM auto-scheduledIris print-pipeline-hour / melodic-bee Scheduled 0s Scheduled for 2022/09/01 11:28:56 PM auto-scheduledIris print-pipeline-hour / literate-lemming Scheduled 0s Scheduled for 2022/09/01 11:27:56 PM auto-scheduledIris print-pipeline-hour / congenial-monkey Scheduled 0s Scheduled for 2022/09/01 11:27:22 PM auto-scheduledIris print-pipeline-hour / opalescent-leech Scheduled 0s Scheduled for 2022/09/01 11:27:17 PM
m

Michiel Verburg

09/02/2022, 8:34 AM
This somehow seems similar to something I am experiencing currently and trying to debug and scavenger hunt for similar issues. What version of prefect are you using? I am using 2.0.4
j

Jeff Hale

09/02/2022, 11:30 AM
I suggest upgrading to 2.3.1 if possible, @Michiel Verburg.
m

Michiel Verburg

09/02/2022, 11:32 AM
I am indeed currently in that process, after thorough debugging it seemed to indeed have to do with the whole transition from beta to GA and changes surrounding it.
But thanks for confirming that I am definitely doing right by investing time now in doing the update! Because initially we were planning it like next week or so
👍 1
j

Jeff Hale

09/02/2022, 12:19 PM
@Venkat Ramakrishnan I just ran your deployment code with 2.3.1 and it created a schedule for every hour.
v

Venkat Ramakrishnan

09/02/2022, 4:33 PM
Not sure. I didn't find the issue consistently reproducible, so I cannot say for sure if it has been fixed in the latest version. By the way, I had been running in Windows, but now planning to shift to Linux tomorrow. If I see it again, I will update the thread. Thanks.
:thank-you: 1
👍 1