Hi all I m in the process of migrating a mono repo of schedu Prefect Community #ask-community

Hi all, I’m in the process of migrating a mono-rep...

Leon Kozlowski

06/09/2021, 9:20 PM

Hi all, I’m in the process of migrating a mono-repo of scheduled tasks over to prefect. Does anyone have any deployment patterns they utilize for registration via CLI while maintaining each ‘service’ as an independent docker image with a Dockerfile in each service subdirectory? (Example Below)

Leon Kozlowski

06/09/2021, 9:21 PM

Prefect Version: 0.14.19 Storage Type: Docker Example Project Structure:

Copy code

services/
    service_one/
        src/
            __init__.py
            tasks.py (holds all task definitions)
            build.py (holds flow definition via context manager)
            deploy.py (holds storage, run config, and schedule)
        Dockerfile
    service_two/
        . (etc)

What I am trying to do is utilize the

prefect register

command to register each flow in the

services/

folder but storing them each independently Something like:

Copy code

$ prefect register --project <PROJECT> --path services/ --label <LABEL>

Which I know will not work work due to the fact that the flow definitions are buried in the sub directories.

Kevin Kho

06/09/2021, 9:52 PM

Hey @Leon Kozlowski, I don’t have a good answer for this other than to write a

Makefile

and use that unfortunately. We’ll see if the community has other ideas.

Leon Kozlowski

06/09/2021, 10:29 PM

Thanks @Kevin Kho this is somewhat of a one off use case to move this existing monorepo — appreciate the feedback

Open in Slack

Previous Next