https://prefect.io
Join Slack
Has anyone had to pip install a private github repo as a dependency in their Dockerfile while using ...
# ask-community
l
Has anyone had to pip install a private github repo as a dependency in their Dockerfile while using DockerStorage?
k
Hey @Leon Kozlowski, I have not done it myself but I think you would copy your deploy_key over to the container and then use that to clone and install like this . If anyone else has actually done it, I’d like to learn too
Actually I think this solution is easier?
l
I suppose that the personal access token could be exposed in a CI/CD environment
k
I see what you mean.
l
This is basically in absence of a private artifactory
I think something like could work:
Copy code
flow.storage = Docker(
    extra_dockerfile_commands=[
        f"RUN pip install --no-cache-dir 'git+https://{os.getenv('TOKEN')}@<gitServerAddress>/<orgName>/<packageName>@<version>#egg=<packageName>[<extras>]'"
    ],
    ...
)
In which TOKEN is exposed in a CI/CD environment where the 
register
command is executed
5 Views
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by