I have several tasks where I call out to the shell using subprocess. When I
flow.run()
locally, I see all the stdout information from these subprocesses in the prefect log output. But I do not see the same information in prefect cloud. Is there a configuration setting or something I can update to ensure I see this output in the cloud logs?
Adam Roderick
10/29/2019, 12:13 PM
If I capture the output of subprocess.check_output() and log it using the prefect logger, I get the output I was looking for
j
josh
10/29/2019, 1:13 PM
Yep that would be the way of getting that information to cloud. Cloud only takes in logs sent through the prefect logger and not anything which is generally printed to stdout
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.