Is there any way with GKE to tag logs with the pre...
# prefect-kubernetesj
Josh
12/13/2022, 2:22 AMIs there any way with GKE to tag logs with the prefect task id that the log belongs to? I can see flow run ID as part of the logging tabs, but can I get more granular?
c
Christopher Boyd
12/13/2022, 2:06 PMyou should be able to include the TaskRunContext which has task_run_id
j
Josh
12/13/2022, 5:28 PMHow would we do that?
c
Christopher Boyd
12/13/2022, 5:42 PMyou would have a task logger for the task, and log that taskrunContext in that - https://docs.prefect.io/api-ref/prefect/context/#prefect.context.get_run_context
and https://docs.prefect.io/api-ref/prefect/context/#prefect.context.TaskRunContext
Christopher Boyd
12/13/2022, 5:44 PMI’m not sure if GKE is doing anything special specifically for logging, but Prefect itself is logging based on the default logging configuration + whatever you have additionally configured. Additional configuration to raise / export the task run context and ID would be exported / logged based on these values here
Christopher Boyd
12/13/2022, 5:45 PMit looks like what you posted above is a K8s job in prefect v1?
Christopher Boyd
12/13/2022, 5:48 PMI don’t believe that task ID’s are part of the job, but would need to verify. That said, surfacing that can be done using the logger and just adding it manually e.g. https://discourse.prefect.io/t/how-can-i-add-logs-to-my-flow/86