Hi! I am trying to figure out why one of my flows finishes all my tasks but does not mark the flow as completed (intermittent issue). Did not have this problem on Prefect 1.
I'm returning medium sized dataframes from many of my tasks, are something done with the output of the tasks at the end of the flow that could cause an issue here?
I am running with docker container, and get the exit message from the docker container but not flow complete
b
Bianca Hoch
09/23/2022, 9:12 PM
Hi Andreas, did you notice any error messages in the agent logs or container logs?
a
Andreas Nord
09/24/2022, 5:32 PM
Nope, and I ran with DEBUG logging
Andreas Nord
09/24/2022, 5:35 PM
How can I find the container log, do you mean the output stream?
Andreas Nord
09/26/2022, 7:29 AM
Checked the logs in
Copy code
/var/lib/docker/containers/<container_id>
does not have any errors. Another thing to add is that in the cases where the flow manages to finish, it takes around a minute between tasks finishing and flow being marked as finished
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.