Is there a way to get help on how to run an Agent on AWS EC2 ? I think I've done everything properl...

Chris McClellan

05/12/2021, 11:08 PM

Is there a way to get help on how to run an Agent on AWS EC2 ? I think I've done everything properly but it still doesn't work like I expect/want. Am I expecting the right thing ? I have an existing EC2 (t2.micro) that I want to run an agent on and the python scripts are stored in a folder on the EC2. Is there a more recommended/cheaper architecture than this ?

Kevin Kho

05/12/2021, 11:09 PM

Hey @Chris McClellan! That seems to be the cheapest. Isn’t it just a matter of SSH-ing into the EC2 and running the agent in detached mode and leaving it on? What Python scripts are you storing there?

Kevin Kho

05/12/2021, 11:10 PM

Are you using

local agent

on the EC2 instance and using it to run flows too?

Chris McClellan

05/12/2021, 11:11 PM

Yeah, the EC2 is permanently on. Detached mode - unsure

Chris McClellan

05/12/2021, 11:12 PM

the Python scripts are the flows that I want to execute. I've just started using Prefect, so I might have it setup the wrong way but it works 🙂

Chris McClellan

05/12/2021, 11:12 PM

yes, I'm using "local agent", but I thought "ecs agent" was a better option ?

Kevin Kho

05/12/2021, 11:45 PM

https://docs.prefect.io/orchestration/agents/local.html#using-with-supervisor

Jimmy Le

05/13/2021, 3:42 PM

I have a Replit account and have been using their always on feature to run my ECSAgents: https://replit.com/@lejimmy/ecs-agent

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.