Hi all I m trying to migrate my Docker based Prefect flows f Prefect Community #prefect-docker

Hi all. I'm trying to migrate my Docker-based Pre...

Toby Coleman

07/20/2023, 1:40 PM

Hi all. I'm trying to migrate my Docker-based Prefect flows from Prefect Agent over to the new Prefect Worker. I have a couple of questions: 1. The Docker work pool doesn’t appear to have any settings relating to the container registry. How can I set it to use the Docker registry block that I have defined in Prefect? 2. Am I correct in thinking that I will need a separate Docker work pool for each image that I want to use in my jobs? For example if deployment

uses

my-org/image1:latest

and deployment

uses

my-org/image2:latest

, then these cannot share a work pool, instead I will need to create separate pools with different images configured on each one?

✅ 1

Toby Coleman

07/21/2023, 9:27 AM

I think I found the answer to question 1 here: https://github.com/PrefectHQ/prefect-docker/issues/72

Jamie Zieziula

07/25/2023, 11:49 PM

for 2 - you can provide job variable overrides at the deployment level! I’ll send an example later this evening

Jamie Zieziula

07/26/2023, 1:07 AM

Copy code

deployments:
  - name: deployment a
    work_pool: 
      name: my-work-pool
      job_variables: 
        image: image1:latest
  - name: deployment b
    work_pool: 
      name: my-work-pool
      job_variables: 
        image: image2:latest

🙌 1

Toby Coleman

07/26/2023, 3:20 PM

Great - thanks @Jamie Zieziula. Regarding 1 - do you know if there is a ETA for the GitHub issue? Happy to contribute if someone can give me a few pointers.

Open in Slack

Previous Next