Hi there. I am having trouble with shell tasks and logging. For example, when I run
DbtShellTask
, it doesn't show output why it's running or when it succeeds. The only time I see the detailed output is when there is a failure.
I tried passing these args and it still doesn't show streamed output in the logs, not even after the task completes.
everywhere I could think of: prefect server, agent, docker storage, run config. I see DEBUG level messages on Prefect Server, but nothing from the task.
I am running 0.14.2
Any ideas?
Pedro Machado
01/11/2021, 4:35 AM
I was able to get it to stream by passing
stream_output=True
but this doesn't explain why it could not see the successful output after the task completed. Thoughts?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.