Robert Banick
09/12/2023, 12:28 PMbotocore
,httpcore
are spamming our Cloudwatch logs with DEBUG statements. Thi happens in sufficient volumes to make the logs much harder to use and cost us real money on a monthly basis.
My hunch is that Prefect is somehow catching these logs and forwarding them on to Cloudwatch. I’ve tried setting PREFECT_LOGGING_ROOT_LEVEL=INFO
on the Dockerfile of the Agent we use to orchestrate but this had no effect. Should I be setting the root level on the container Dockerfile? Or is there something elsewhere I’m missing? Any help would be most appreciated.
Note that I’m concerned about Cloudwatch, not about Prefect UI — I get only the INFO level ETL logs on the Prefect UI, as intended.
Cheers,
RobertBring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by