Hi, if I'm pulling from github, will it always pull the ENTIRE repo? No way to only pull down the directory with my bits in it?
n
Nate
09/03/2024, 2:18 PM
if you're pulling from github, that's correct
you can use s3, gcs or bake code into your image (if docker) if that's prohibitive
or perhaps open an issue about implementing some sparse checkout option in
git_clone
step
c
Chris Phillips
09/03/2024, 2:21 PM
Thanks, one way or another I want the various files tracked in github, I suppose I can just create a dedicated repo, but that in turn makes it a bit obscure when our team is, rightly or wrongly, used to a single repo for scripts and tools and the likes.
👍 1
n
Nate
09/03/2024, 2:21 PM
is your issue that your repo is just too big and its a lot to pull down all the time?
c
Chris Phillips
09/03/2024, 2:28 PM
Well it's a collecting place for various support tools and backups outside of our main code repos. Not my design, but we are where we are!
👍 1
j
john
09/03/2024, 4:54 PM
You could publish it to a pypi index with some of the submodules optional on install