Hi! Question about caching - here all tasks have finished, but only one has "duration". Does it mean that all the task that finished, are in one of the successful state, but don't have "duration" were read from cache?
k
Kevin Kho
07/25/2021, 10:26 PM
Hey @Krzysztof Nawara, will ask the team tom (and also the other question)
Kevin Kho
07/26/2021, 3:56 PM
Hey @Krzysztof Nawara, it looks like for this one that the ones without duration were read from the cache as they have no Start Time so we can’t calculate a duration. I think you can also verify this behavior if you run the Flow with debug level logs.
k
Krzysztof Nawara
07/26/2021, 4:20 PM
How do I run flow with debug-level logs? I set export PREFECT__LOGGING__LEVEL=DEBUG for the terminal from which I'm running
prefect server start
but it doesn't seem to be enough.
Do I need to specify it for agent/flow when submitting/ both?
k
Kevin Kho
07/26/2021, 4:28 PM
The agent logs and flow logs are separate. I think it’ll be easier to do it from the run config like
. It’s a bit harder if you are using the Python interface to spin up the agent. You need to modify the
config.toml
with:
Copy code
[cloud.agent]
level = "debug"
Kevin Kho
07/26/2021, 4:29 PM
Yes that environment variable needs to be on the machine that is running the Flow (not on the serve machine)
k
Krzysztof Nawara
07/26/2021, 8:46 PM
Okay, so to be able to see DEBUG level logs in Prefect UI it's enough to set _export PREFECT__LOGGING__LEVEL=DEBUG_ for my Python script which will be submitting (calling flow.submit()) flow? And then that version of a flow will always be executed with DEBUG logging?
k
Kevin Kho
07/26/2021, 8:52 PM
A bit unclear what you’re asking. The environment variable
PREFECT___LOGGING___LEVEL
needs to be on the agent that is executing the Flow. If you export it and register on a different machine, that environment variable will not be registered along with your Flow.
The way to attach it to you Flow through be through the RunConfig like
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.