Hi Community, I'm looking for some guidance. I am ...
# ask-community
v
Hi Community, I'm looking for some guidance. I am busy flipping our Flows from agents to workers since agents are getting depreciated soon. I have noticed our Flows running significantly slower with workers. Has anyone had similar issues? Any pointers and advice will be appreciated! Thanks!
m
Are the actual flows running slower, or are they just being enqueued at a slower rate? I haven't used agents myself. If it's the latter the setting
PREFECT_WORKER_QUERY_SECONDS
can be used to change how often workers poll for new flows to start and is by default set to
15
which is too high in my opinion. Relevant docs: https://docs.prefect.io/latest/concepts/work-pools/#polling-for-work
v
Hi Morten, thanks for your reply. Its the actual flow itself. The tasks in the flows running on agents would usually complete < 1 minute. However, the tasks of flows running on workers sometimes complete quickly but mostly the tasks would take 4 - 6 minutes to complete.
m
That's interesting. I'm afraid I can't be of much help in that case, but I would create some example flows that start X number of tasks and create a small, but reproducible example that showcases the performance difference in a Github issue.
upvote 1
thank you 1