Matt Drago
12/16/2020, 12:00 AMGCRResult
. I have Prefect running in a kubernetes cluster, using the KubernetesRun
with Docker
storage. I've set the created the GCRResult
using:
result = GCSResult(
bucket='REDACTED',
location='flow-results/{flow_name}/{date:%Y/%m/%d}/{task_name}_{task_run_id}.prefect'
)
And assigned the result to the flow with:
with Flow("Redacted", schedule=schedule, result=result) as flow:
Weird thing is that the bucket name is being used to store the Result files, but not using the location template that I have provided. One thing that I noticed was that for one task (a function with the @task
decorator), I passed in an argument with the name date
and that Task did have it's Results stored in the location according to the template.Chris White
results
on your tasks, or are you specifying a target
on your tasks? If not, we might need to transition to a GitHub issue with a reproducible example to debug furtherMatt Drago
12/16/2020, 5:45 AMresult
on the flow (note result
singular not plural) and I'm not setting a target
on any of the Tasks.Chris White
@cicdw
if you do open oneMatt Drago
12/16/2020, 5:55 AMalternatively, you can provide a location template format string which will be templated with values in Prefect context at runtime.
Do you think it would be worth changing this to mention that the template will use the values from the run's parameters, the context and then that tasks arguments and explain the preference for which set has precedence?Chris White
Marvin
12/16/2020, 4:24 PM