Hi, I’m rewriting some prefect 1 flows to prefect 2, and I want to double-check one behaviour change: It seems that in prefect 1, all output from the shelltask command were returned, but in prefect-shell, it appears that logs (typically python logging libraries, output that isn’t technically printed to stdout but none the less shows up on the command line) don’t show up in the prefect logs. Am I understanding this correctly? Is there any way to catch these logs?

Hi! What command are you running?

I’m running Meltano (

meltano run tap-something target-something

). I just now (a few seconds ago) saw the issue in the repo, so I am trying to run it through the prefect module.

You can try adding StreamHandler(sys.stdout) to the meltano logger

Thanks for the suggestion. I’m not very experienced with logging but I can imagine what it does. Sadly, the logging messages comes from code I don’t maintain, and Meltano (a wrapper for singer.io connectors) uses stdout for the application itself. Adding the logging messages to stdout would in all likelihood make the application fail. This isn’t really critical though, it would just be nice to have.

You can to change logger configuration https://docs.meltano.com/guide/logging

You can set the

PREFECT_LOGGING_EXTRA_LOGGERS

environment variable. (Notice that in prefect v2 it is spelled withOUT the double underscores)

PREFECT_LOGGING_EXTRA_LOGGERS=requests,boto3,my_custom_logger python my_module.py