Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

image.png

Hello all,

When deploying flows from a python using an RRule scheduler to schedule daily updates, I’m consistently seeing odd behavior where a flow gets duplicated many, many times, 1-3 seconds apart. See below screenshot — ~100 more flows for 3 days follow, when I expected to see only 3.

Any ideas what might cause this? The RRule scheduler in question is `FREQ=DAILY;BYHOUR=10;BYMINUTE=21`.

Even more curiously, sometimes the schedule will seem to work correctly immediately after running. Then I will check back some hours or a day later and the duplication will have happened.

I’ve seen this for a quite a number of my flows. It causes failures as flows either interrupt one another, overwrite each other, or otherwise cause disruptions. Not to mention it’s a waste of resources when these need to run daily only.

Notably if I switch to interval scheduling from the UI this error disappears — the duplicate schedules go away and never return.