Jon
11/07/2023, 10:48 PMNate
11/07/2023, 11:25 PMJon
11/08/2023, 1:46 AMNate
11/08/2023, 1:46 AMJon
11/08/2023, 2:00 AMname: pipelines
prefect-version: 2.14.3
pull:
- prefect.deployments.steps.set_working_directory:
directory: /app/projects/pipelines
definitions:
work_pools:
dc_work_pool: &dc_work_pool
name: "{{ $WORK_POOL_NAME }}"
job_variables:
image: "{{ $REGISTRY }}/{{ $IMAGE_NAME }}:{{ $TAG }}"
deployments:
- name: my_flow_docker_pool_2
entrypoint: dc/pipelines/test_flow.py:my_flow
work_pool: *dc_work_pool
for some reason, reading an env var for the work pool name does not workJon
11/08/2023, 2:01 AMJon
11/08/2023, 2:01 AMJon
11/08/2023, 2:02 AMThis deployment configuration references work pool '{{ $WORK_POOL_NAME }}' which does not exist. This
means no worker will be able to pick up its runs. You can create a work pool in the Prefect UI.
Jon
11/08/2023, 12:11 PMNate
11/08/2023, 3:24 PMNate
11/08/2023, 3:24 PMJon
11/08/2023, 3:26 PMJon
11/09/2023, 1:05 PMdefinitions:
work_pools:
work_pool: &work_pool
name: "{{ $WORK_POOL_NAME }}-{{ $ENV }}" # ideally we do something like this
Nate
11/09/2023, 5:34 PMwork_pool
name
field for some reason, which seems like bug. so i agree with your (I presume) commentNate
11/09/2023, 5:34 PMJon
11/09/2023, 5:46 PMJon
11/15/2023, 3:22 PMNate
11/15/2023, 3:56 PMJon
11/15/2023, 6:58 PMJon
11/16/2023, 12:04 PMNate
11/16/2023, 4:57 PM