A question for the brain trust. I am interested in using the

on_completion

and

on_failure

hooks made available for tasks and flows. In the past I would put cleanup / success logic as a distinct

task

in my pipeline. These tasks have their own loggers that would report some items. The following is with regards to callbacks supplied to the

on_completion

and

on_failure

hooks of a flow. What is the correct way of using the

logging

module and a

logger

object to emit info/warn messages that are also recorded by the prefect server? A

logger = get_run_logger()

call in one of my

on_completion

callback functions raised a context error, and

print

statements with

log_print=True

don't seem to be captured either. I guess ultimately I am curious about whether these call back functions are extecuted within or outside a flow context.

this works for me

def task_completion_hook(task, task_run, state):
    from prefect.logging.loggers import task_run_logger
    logger = task_run_logger(task_run, task)
    logger.warn("TEST")

Interesting. Does this work for a flow as well? I have not tried to import the logger in that way before. I will give it a whirl.

@Tim Galvin not sure if this is intended usage of the flow/task run logger. i just found it in the

get_run_logger

method.

As in by reading the source of the

get_run_logger

method?

yes https://docs.prefect.io/latest/api-ref/prefect/logging/?h=#prefect.logging.get_run_logger