https://prefect.io logo
t

Tony Yun

07/26/2023, 1:10 PM
Hi, is there any configuration controlling the prefect2 log to steaming into UI? I’ve seen any of our KubernetesJob flows won’t show any logs until it’s finished.
n

Nate

07/26/2023, 2:29 PM
hi @Tony Yun - have you set
stream_output=True
on your k8s work pool config? or set it as an override on the deployment?
t

Tony Yun

07/26/2023, 2:46 PM
How is it set? I don’t see this option:
n

Nate

07/26/2023, 2:48 PM
it looks like you're still using agents, so you'd want to set this on the infra block
t

Tony Yun

07/26/2023, 2:48 PM
We use the k8s block as runtime enrivonment, is it settable here?
oh yeah I just checked it’s configured to true:
but I never see logs really streamed to UI until the flow finished
our prefect agent is 2.8 and k8s block using prefect 2.10 version
n

Nate

07/26/2023, 3:22 PM
how long is your flow run? i.e. how long between the time you'd expect logs to come back vs when they do?
t

Tony Yun

07/26/2023, 3:25 PM
My flow runs 40minutes and I won’t see logs until it finishes
hi @Nate is there an update here?
n

Nate

08/02/2023, 3:51 PM
sorry @Tony Yun - I'm not exactly sure why thats happening. do you have agent logs from when this was happening?
t

Tony Yun

08/02/2023, 3:52 PM
does k8s pod logs stream to agent logs and then to UI?
yes we don’t have problem in agent stream logs. it’s streamed there
but it’s not streaming to UI
I’m thinking we still miss some configurations to stream to UI