Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi - I am looking for guidance on deploying a simple E,T,L `Flow` with a schedule to run once a day at a specific time on the cloud (AWS).  The size of the data is sub 1 mb.   Should the ETL flow have a scheduler? -- Thanks in advance.

Hi <@UNSQ0T2V9>! Prefect is a natural for this. For deployment and scheduling, Prefect Cloud offers a Hybrid solution in which your data and your flow's execution runs on _your_ infrastructure but you can leave the scheduling up to us. We have a great tutorial that will walk you through doing just that - writing an ETL flow that you can run on your infrastructure but leave the scheduling up to us. Here's the tutorial: <https://docs.prefect.io/core/tutorial/01-etl-before-prefect.html>.

To sign up for a free Scheduler account, you can visit <http://cloud.prefect.io|cloud.prefect.io> :slightly_smiling_face:

<@UN6FTLFAS> Ok.  I saw that.  And very good to know that is what I should be following :slightly_smiling_face: How does the lambda get invoked ? The example does not take you to deployment as far as I can tell.

We have a great blog on that exact scenario! <https://medium.com/the-prefect-blog/event-driven-workflows-with-aws-lambda-2ef9d8cc8f1a>