Ofir03/21/2023, 11:25 PM
Contextual data about the run will be attached to the log records.The goal is to be able to piece all events and actions related to a single client transaction. So if I have transaction id (X-Correlation-ID HTTP header) set to 1234, I want to use the Prefect logger and attach this token id (1234) to the logs, so later on I can debug related events in the stream. BTW, we are using Grafana Loki and promtail to periodically collect all events from all microservices into a time-series database. The context of this question is unified logging, and obviously debugging failures in production, and also during development of workflows. Motivation is that there may be multiple different runs of the same workflow and we want to correlate and group events related to the same transaction that was initiated by the end user on our platform. Thanks!
Sahil Rangwala03/22/2023, 6:45 PM