Adam
04/13/2023, 8:56 PMChris White
04/13/2023, 9:37 PMdockerfile: auto
on the docker build step, it will create a dockerfile and build the image for you -- Prefect persists this dockerfile within the container so you can inspect it and copy / paste it to build on top of it and customize it furtherAdam
04/14/2023, 12:51 PMChris White
04/17/2023, 4:49 AMThese have specifications and was planning on containerizing all the requirements, creating a virtual env and running that virtuallyI still don't see why you'd need a virtual environment if the container itself is purpose-built to have your runtime requirements already present; ultimately it's OK if you want to do both, there's just increased risk for weird issues
Scheduled
state but not to execute those runs - that's where the agent / worker comes in. It pulls runs that are ready for execution off a queue created by the scheduler. At this exact moment, you'll need to run your ECS agent in a VM somewhere 24/7 but we totally recognize that this defeats part of the value of ECS and will be offering a "managed worker" service in the next few weeks that submits jobs to your ECS instanceAdam
04/17/2023, 12:56 PM