. The issue I have is that I have a handler which sends notifications with details on the failing flows but when dbt task fails with return code 1, all i get is
'Command failed with exit code 1'
is there a way to capture in a variable the logs of a failed shell task to then process them and display them using the handler?
a
alex
05/12/2022, 12:45 PM
Hey @Andres! Since
DbtShellTask
subclasses
ShellTask
, I believe that you can use the
steam_output
option to log the output of the command that you’re running. Here’s a link to the
We have quite a lot of resources about dbt collected under the dbt tag on Discourse if you are interested, e.g. this post dives deeper into it, but you can use those two arguments to capture logs and stdout from dbt runs:
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.