Hi, I have an EC2 VM with orion (renamed API few days ago if I understood correctly) and an EC2 VM with an agent
what would you recommend/any ressources/docs to handle scalability & installing of (python) dependancies ?
for now I'm login via ssh to the agent, git fetch, git checkout the poetry lock /pyproject.toml then installing dependancies
I don't have time and competence to use maintain kube for now, is managed kube suitable for my small usecase ?
c
Christopher Boyd
02/28/2023, 1:54 PM
Hi flapili - what do you mean maintain depdencies?
If you need them on your EC2 instance, I would suggest just pre-installing them.
Alternatively, you can run the docker agent on the ec2 instance, then package your docker images with the appropriate dependencies, but at that point you aren’t far off from just using a k8s cluster
f
flapili
02/28/2023, 1:58 PM
I mean if I want to add a new lib I for a new flow a example must login on agent and install it
c
Christopher Boyd
02/28/2023, 1:59 PM
Yea
f
flapili
02/28/2023, 1:59 PM
so I'm wondering if using poetry | pip programatically first isn't a good way ?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.