Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hey! I'm looking to schedule a flow to happen daily, but I don't want the server to be running locally. What is the best way/best agent or executor to use to achieve this?

Hey <@U01KX424L3G>,
If you choose to forego a backend API, you can run a flow in a local process with <https://docs.prefect.io/core/concepts/schedules.html#simple-schedules|a schedule> that will kick off FlowRuns at each determined interval, but this will be a long running process that isn’t ideal for most users. Additionally, you won’t be using an Agent at all since the Agent is a part of the orchestration layer part of your system and asks your backend API if it needs to execute any Flow Runs every 10 seconds (which we won’t have in this case).

Overall, I would recommend signing up for a <https://www.prefect.io/get-prefect/|free Cloud> account! That way you don’t have to worry about running a backend and you can run your Agents in your preferred environment (in your case, probably the <https://docs.prefect.io/orchestration/agents/local.html|LocalAgent>). You can even orchestrate/schedule using <https://docs.prefect.io/orchestration/ui/flow.html#settings|solely the Cloud UI> with a running Agent.

I have a cloud account! I am just wondering what agent I should be using and how to run that agent on the cloud so that I do not need to start the agent locally

Great! Any <https://docs.prefect.io/orchestration/agents/overview.html|Agent> will work in that case, so this decision will be based on your preference of cloud platform / your execution environment.

Here’s an <https://towardsdatascience.com/serverless-data-pipelines-made-easy-with-prefect-and-aws-ecs-fargate-7e25bacb450c|article> on getting an Agent up and running on ECS, as an example.