Hi there. I am wanting to run a flow on prefect server with a custom schedule. The schedule is set with an interval clock that runs everyday and generates a clock for roughly 4000 parameters.

schedule = Schedule(
    clocks=[
        IntervalClock(
            start_date=pendulum.datetime(2020, 12, 1, 16, 20, 0, tz="Australia/Sydney"),
            interval=timedelta(days=1),
            parameter_defaults=param
        )
        for param in parameters
    ]
)

However when I deploy the flow to prefect server it runs 10 out of my 4000 odd params and schedules another 10 for tomorrow. Is there a limit to how many Interval clocks I can use with the prefect server schedule or potentially some other reason why it isn't queuing the full set of params to be run? Cheers, Phil

Hi @Philip Evans - Prefect Scheduler runs at a ten minute interval and schedules 10 runs at a time: https://docs.prefect.io/orchestration/concepts/services.html#scheduler For what you're trying to do, you could try mapping through those params in your flow: https://docs.prefect.io/core/concepts/mapping.html#simple-mapping or if you want separate flow runs, you might use the startFlowRunTask: https://docs.prefect.io/api/latest/tasks/prefect.html#startflowrun

Thanks @Jenny! I think your final suggestion will work perfectly. I will give that a go. 👍

👍