schwannden kuo
11/17/2023, 8:32 AMname: flows
prefect-version: 2.14.2
# pull section allows you to provide instructions for cloning this project in remote locations
pull:
- prefect.deployments.steps.set_working_directory:
directory: /opt/prefect
# the definitions section allows you to define reusable components for your deployments
definitions:
tags: &common_tags
- "sat"
work_pool: &common_work_pool
name: "k8s-pool"
job_variables:
image: "{{ build-image.image }}"
# the deployments section allows you to provide configuration for deploying flows
deployments:
- name: "flow"
schedule: null
entrypoint: "src/sat/sub_flows/flow.py:flow"
work_pool: *common_work_pool
Is there a flag jere where I can configure auto cleanup setting? Or perhaps in worker pool settings?Kevin Grismore
11/17/2023, 3:55 PMFinished Job TTL
which specifies:
The number of seconds to retain jobs after completion. If set, finished jobs will be cleaned up by Kubernetes after the given delay. If not set, jobs will be retained indefinitely.
schwannden kuo
11/23/2023, 2:32 AMBring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by