Hi team I am trying to find which flow is eating up all my a

Question

Hi team I am trying to find which flow is eating up all my agent s resources so have a couple of questions Is each run forked ie will resources be reclaimed when the run finishes Is there a way to get memory usage per flow run

Zachary Hughes · Answer

Hi Kostas how are you running your flows locally Kubernetes etc

Kostas Chalikias · Answer

Hello We use the cloud scheduler and an agent running on Heroku I guess you could call it a local agent

Kostas Chalikias · Answer

So I logged into the host where the agent is running and I see 21 instances of app heroku python bin python app heroku python bin prefect execute cloud flow and 42 instances of app heroku python bin python app heroku python bin prefect heartbeat task run i lt some id gt May I suspect that cycles are running on top of each other

Zachary Hughes · Answer

Hmmm So the item you re seeing 21 instances of is the actual running of the flow while the 42 instances are us updating our heartbeats

Zachary Hughes · Answer

I m not super familiar with Heroku but you may be able to use `top` to get a better idea of which processes are using memory

Kostas Chalikias · Answer

So can I assume that something is keeping each running of the flows going for longer than it should E g something blocking them from exiting

Kostas Chalikias · Answer

Is it one of those processes per flow

Kostas Chalikias · Answer

I don t think the fact it s heroku is important anyway

Zachary Hughes · Answer

Honestly I d expect the process for the flow to complete once the flow reached a terminal state I imagine you don t actually have 21 flow runs currently running

Kostas Chalikias · Answer

not intentionally slightly smiling face

Kostas Chalikias · Answer

in fact 21 flows is all we have lol

Kostas Chalikias · Answer

so I don t think they are ever terminating

Kostas Chalikias · Answer

and I think I see why

Kostas Chalikias · Answer

So let me try and remove a bad line of code and see if that fixes thanks

Kostas Chalikias · Answer

Good datapoint that its one child process per flow that is useful to know anyway

Zachary Hughes · Answer

Sure thing let me know if I can be of any more help