Hello, there's something I don't understand, when launching a deployment using a KubernetesJob from the UI, I can see the logs of my Flow both in the Agent running in Kubernetes and in the Kubernetes Job pods. Is that expected? (my guess is no). Seems like it's executing my flow twice.
z
Zanie
01/09/2023, 7:14 PM
Do you have
stream_logs
set? We stream logs from the pod to the agent by default.
Zanie
01/09/2023, 7:15 PM
Sorry
stream_output
I think
j
Jean-Michel Provencher
01/09/2023, 7:15 PM
ah ok, right, so that's only a copy of the outputs, not another run itself right ?
z
Zanie
01/09/2023, 7:16 PM
Almost certainly! You can toggle
stream_ouput
on the
KubernetesJob
if you want to be sure, but we have guards against two copies of the same flow run executing
j
Jean-Michel Provencher
01/09/2023, 7:16 PM
can I turn it off from the agent, but keep the stream output to the pod of the KubernetesJob ?
Jean-Michel Provencher
01/09/2023, 7:17 PM
Does not seem possible from the doc I read
z
Zanie
01/09/2023, 7:19 PM
The stream output setting is only for streaming to the agent
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.