Hi Prefect Folks - Is it possible to adjust the log level of a running flow? :thread:

Bradley Hurley

11/07/2022, 4:23 PM

Hi Prefect Folks - Is it possible to adjust the log level of a running flow? 🧵

Bradley Hurley

11/07/2022, 4:24 PM

Normally

INFO

is fine for our use case, but we have seen on occasion something goes wrong and the job pod consumes all the free memory on the kubernetes node and we would like to capture additional logs when we’ve detected abnormal memory usage.

Khuyen Tran

11/07/2022, 4:25 PM

Yes, with

Copy code

prefect config set PREFECT_LOGGING_LEVEL="DEBUG"

Khuyen Tran

11/07/2022, 4:25 PM

https://docs.prefect.io/concepts/logs/

Bradley Hurley

11/07/2022, 4:25 PM

Sorry, I should have stated I am on prefect 1.0.

Bradley Hurley

11/07/2022, 4:26 PM

In my testing it seemed like once a flow was running changing the log level didn’t have any impact.

Khuyen Tran

11/07/2022, 4:27 PM

I’m not very familiar with 1.0, but this might help: https://discourse.prefect.io/t/how-can-i-adjust-log-settings-such-as-the-default-log-level-or-logging-format/116

Bradley Hurley

11/07/2022, 4:28 PM

I attempted to set the environment variable as well as via python setting the global log level to debug.

Copy code

>>> import prefect
>>> logger = prefect.context.get("logger")
>>> logger.getEffectiveLevel()
20
>>> logger.setLevel("DEBUG")
>>> logger.getEffectiveLevel()
10

Bradley Hurley

11/07/2022, 4:32 PM

I have this code in my flow:

Copy code

@task()
def log_debug():
    for i in range(10):
        logger = prefect.context.get("logger")
        logger.debug("Test Debug Message")
        sleep(30)

4 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.