in some of my Prefect task for long running processes. Is there a way to see the output of such process while it’s still running? Currently the output only shows in Prefect logs after the process has finished.
which should be on by default - looks like it should already streamed as an INFO level log
g
Gosia
06/02/2023, 9:30 AM
Thanks, Nate. It should indeed be on by default, but I’ll add it just to be sure. The output does end up in the log, but not until the process is finished. Which is troublesome with long running processes as I can’t see their progress.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.