Hello Prefect community, I’m using a K8s agent with a Dask K8s environment and I’m finding about 1 minute pass by when a run state goes from “Scheduled” to “Running.” Are there any ways to can speed up scheduling? Maybe by configuring the agent?
05/29/2020, 2:56 PM
Hey @Noah Nethery! Is this happening on every run or just the first run of a flow? If it’s just the first run then it’s Kubernetes pulling the images for the first time.
If it’s happening on every run then it could be due to general Kubernetes spin up time for pods / autoscaling
05/29/2020, 3:19 PM
@josh It’s happening every time, it must just be due to the general spin up time. I have a feeling that is determined by the actual instance type we are using for this cluster so maybe that’s it. Thanks!