Hey slightly smiling face I have shared code that is used by

Question

Hey slightly smiling face I have shared code that is used by both prefect flows + system where no prefect is installed Thus I need a logger which is able to log everywhere I created an own logger but have some problems with prefect to get it running I only found documentation on how to set up a custom logger for v1 But I think it should work the same for v2 I also had a look here

Nico Neumann · Answer

my logger py ```import logging import sys logger = logging getLogger my logger logger setLevel DEBUG log stream = logging StreamHandler sys stdout formatter = logging Formatter levelname s asctime s filename s lineno d message s log stream setFormatter formatter logger addHandler log stream ``` my flow py ```from prefect import flow from my logger import logger def regular log print Log inside a regular function logger debug debug info logger error error logger warning warning logger critical critical flow name= my flow def flow log print Log inside a prefect flow logger debug debug info logger error error logger warning warning logger critical critical if name == main regular log print 30 flow log ```

Nico Neumann · Answer

Using prefect gt = 2 6 9 and calling `regular log ` in the main function I get an exception when trying to use my own logger This also happens when I just define the import `from prefect import flow` and have no flow defined ```raise MissingContextError prefect exceptions MissingContextError Logger my logger attempted to send logs to Orion without a flow run id The Orion log handler can only send logs within flow run contexts unless the flow run id is manually provided ``` Using prefect 2 6 8 and calling `regular log ` it does not crash But in any cases I see duplicate logs calling `flow log ` Next to my own logger also prefect prints to logging ``` PREFECT LOGGING EXTRA LOGGERS=my logger python my flow py Log as regular function DEBUG 2022 12 11 22 40 53 949 my flow py 7 debug INFO 2022 12 11 22 40 53 949 my flow py 8 info ERROR 2022 12 11 22 40 53 949 my flow py 9 error WARNING 2022 12 11 22 40 53 949 my flow py 10 warning CRITICAL 2022 12 11 22 40 53 949 my flow py 11 critical Log inside a prefect flow 22 40 54 366 | INFO | prefect engine Created flow run spry mayfly for flow my flow DEBUG 2022 12 11 22 40 54 445 my flow py 16 debug 22 40 54 445 | DEBUG | my logger debug INFO 2022 12 11 22 40 54 446 my flow py 17 info 22 40 54 446 | INFO | my logger info ERROR 2022 12 11 22 40 54 446 my flow py 18 error 22 40 54 446 | ERROR | my logger error WARNING 2022 12 11 22 40 54 446 my flow py 19 warning 22 40 54 446 | WARNING | my logger warning CRITICAL 2022 12 11 22 40 54 446 my flow py 20 critical 22 40 54 446 | CRITICAL | my logger critical 22 40 54 462 | INFO | Flow run spry mayfly Finished in state Completed ```

Nico Neumann · Answer

So in prefect gt = 2 6 9 I cannot use the extra logger and in any version I see duplicate logs when using my logger inside a prefect flow Do I need to set some configuration to avoid this

Anna Geller · Answer

you should be able to set the names of all custom loggers as comma separated values on this setting ```prefect config set PREFECT LOGGING EXTRA LOGGERS= logger1 logger2 logger3 ``` if this doesn t work as expected e g you see duplicated logs could you open a GitHub issue with a minimal reproducible example alternatively from 2 7 on you can add `log prints=True` on any decorator to log print statements

Nico Neumann · Answer

Thanks < Anna Geller> I also tried `prefect config set PREFECT LOGGING EXTRA LOGGERS= my logger ` but it crashes with the same message on 2 6 9 2 7 1 And inside the flow I see the same duplicate messages I tried `log prints=True` and it works great slightly smiling face But I want to be able to distinguish between the different logging levels and also save the logs to a file I will open a Github issue with the minimal example above

Nico Neumann · Answer