Hawkar Mahmod
04/14/2021, 7:02 AMflow.register()
or prefect register
? I'm using S3
Storage and ECS
Run Config. I was previously using Docker
Storage but didn't like the rebuilding of the image each time the flow code changed. I am using AWS CodePipeline/CodeBuild, so I have Docker daemon at my disposal, and I have a base image that contains the whole repo the flow sits in. Ideally, in my build environment I can build the base image if necessary, and register my flow with Prefect Cloud. However it seems I can't register unless I have all my dependencies, which happen to sit in the base image anyway. So perhaps I docker run
and register this way?
I've read the GitHub discussion on flow deployment patterns but I am not fully clear on this particular question.Hawkar Mahmod
04/14/2021, 7:03 AMS3
Storage if I have to register inside my base Docker image with docker run
.Kevin Kho
Kevin Kho
Kevin Kho
docker run
. You can just register by calling the Python script python flow.py
, so it’s not coupled with the Docker image.Hawkar Mahmod
04/14/2021, 2:39 PMAre you using the container that holds your dependencies as the container for development also?Not strictly no. I’ve just got a Python project locally, with dependencies installed using Poetry. I have a Dockerfile that contains all of this project, including all flows and dependencies and Poetry files.
Hawkar Mahmod
04/14/2021, 2:40 PMYou don’t need to register withYes but to run. You can just register by calling the Python scriptdocker run
, so it’s not coupled with the Docker image.python flow.py
python flow.py
you need to have everything in the flow imported. So all the dependencies need to be there. Are you saying that the image I use for my CI build environment should be that base Docker image?Kevin Kho