Question about the prefect.io cloud: are there any plans for something like an “agent/compute hosting service”? Devops/infrastructure is kind of my weak point (and therefore my orgnizations’ weak point), so managing a docker instance on a VM is kind of a pain. I’d totally pay for someone to do that for me and I can just focus on the pipeline code.
j
Jeremiah
11/15/2021, 3:03 PM
Hi @Greg Adams! No first-party solution to announce (quite yet) but nearer term we will be focused on making push-button execution environments available with our public cloud partners. And we can definitely provide guidance/assistance with ways to achieve that.
k
Kevin Kho
11/15/2021, 3:06 PM
Hey @Greg Adams, I think the easiest way to achieve this in the mean time is to create an ECS service that will keep an agent alive. This shows how to do it for the ECS agent, but you can also use this for the local agent if you change your command from
Copy code
"command": ["prefect","agent","ecs","start"],
to
Copy code
"command": ["prefect","agent","local","start"],
to spin up a local agent
👏 1
g
Greg Adams
11/15/2021, 3:10 PM
@Jeremiah that would also be nice, anything I can do to help?
👍 1
Greg Adams
11/15/2021, 3:11 PM
@Kevin Kho thanks! I think I’ll try ECS out, too. Been Google Cloud for so long, guess it’s time to learn more AWS.
j
Jeremiah
11/15/2021, 3:13 PM
We’ll definitely be posting as we have more to discuss. Nothing immediate-term, but lots on deck for next year.
k
Kevin Kho
11/15/2021, 3:13 PM
Ah ok. If you are with GCP, there is documentation here to use
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.