Apologies is this is just my lack of knowledge on pytest but is there a way to use Prefect’s existing logging (with customization - e.g. flow_name, task_name, etc) within the context of a pytest test?

I'm not quite sure what you mean

when I ran pytest with a test that defined and ran a flow, the logging output wasn’t the same as when I run a normally. I have log_cli=true for pytest config, but it seems like maybe pytest is overriding the prefect logger behavior

Hm interesting. You could take a look at our conftest.py - pytest will capture logs and display them in its own format but it will also capture stderr which will have logs in our format

thanks I’ll take a look

There is definitely some subideal logging behaviour overwrite happening when running Prefect 😕 see also this thread: https://discourse.prefect.io/t/stdout-not-logged-with-log-prints-true/2818

I mean… you want us to override

sys.stdout

with a duplexing handler?

@Zanie in the context of this thread I was more referring to the fact of my post that when I added my own logging handler in a package it was somehow overwritten and not called in the context of a flow or task - in the a normal python execution context it was called - and imho that shouldn’t happen 🙂

Unfortunately Python logging doesn't really support incremental updates well and we need to take control of logging to provide the UX our users want. We provide full control over the logging configuration so you can usually do what you need. If you want to dynamically create handlers support is complicated, if you open a GitHub issue we can try.

Will look deeper into this, thanks @Zanie for your responses!