Did anyone try to build a multi stage Docker image for use with prefect? I'm using python:3.8-buster...

xyzy

04/07/2021, 8:06 PM

Did anyone try to build a multi stage Docker image for use with prefect? I'm using python:3.8-buster as the base for the builder and python:3.8-slim-buster for the main file, but I get errors like this when trying to do a KubernetesRun:

Copy code

Pod prefect-job-6ab817cf-d6446 failed.
	Container 'flow' state: terminated
		Exit Code:: 1
		Reason: Error

DockerRun doesn't even continue after pulling the image.

Kevin Kho

04/07/2021, 8:11 PM

Hey @xyzy, is there anything you’re looking for that our base images don’t cover?

xyzy

04/07/2021, 8:12 PM

Still experimenting, but I'll probably need compilers and I'd prefer to specify Prefect Version in Pipenv

xyzy

04/07/2021, 8:17 PM

not sure about compilers yet, though... it won't be until much later that I know if I really need them

xyzy

04/07/2021, 8:25 PM

well, for now I've reverted to single stage with python:3.8-slim-buster as the base, until its clear if I really need compilers

xyzy

04/07/2021, 8:27 PM

I assume there are no big downsides compared to using a Prefect generated image, right?

Kevin Kho

04/07/2021, 8:34 PM

This is a use case so it does make sense to provide your own image sometimes.

8 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.