https://prefect.io logo
Title
s

Santhosh Solomon (Fluffy)

12/12/2022, 2:14 PM
I have got below error while running my code in Prefect cloud. The flow generated large number of tasks, so I am assuming there is a limit for number of tasks per flow?
12:48:12.659 | ERROR | prefect.infrastructure.process - Process 'optimal-toucanet' exited with status code: -9; This indicates that the process exited due to a SIGKILL signal. Typically, this is caused by high memory usage causing the operating system to terminate the process.
j

Jeff Hale

12/12/2022, 3:08 PM
Hi Santosh, According to the error, it looks like there is probably not enough memory on your infrastructure for all the work.
s

Santhosh Solomon (Fluffy)

12/12/2022, 3:34 PM
@Jeff Hale We got this from prefect cloud.
j

Jeff Hale

12/12/2022, 3:37 PM
The log is in Prefect Cloud, but the infrastructure where you are running your flow is not - it’s on your local machine if you didn’t set up an infrastructure block. Your code runs on your infrastructure. It looks like the memory requirements for your code were more than your infrastructure can handle, if the error message is leading us down the correct path.
s

Santhosh Solomon (Fluffy)

12/12/2022, 3:37 PM
This gives me a direction to debug. Thanks 👍🏽