Hi - I am looking for guidance on deploying a simple E,T,L

Flow

with a schedule to run once a day at a specific time on the cloud (AWS). The size of the data is sub 1 mb. Should the ETL flow have a scheduler? -- Thanks in advance.

Hi @itay livni! Prefect is a natural for this. For deployment and scheduling, Prefect Cloud offers a Hybrid solution in which your data and your flow's execution runs on your infrastructure but you can leave the scheduling up to us. We have a great tutorial that will walk you through doing just that - writing an ETL flow that you can run on your infrastructure but leave the scheduling up to us. Here's the tutorial: https://docs.prefect.io/core/tutorial/01-etl-before-prefect.html. To sign up for a free Scheduler account, you can visit cloud.prefect.io 🙂

@nicholas Ok. I saw that. And very good to know that is what I should be following 🙂 How does the lambda get invoked ? The example does not take you to deployment as far as I can tell.

We have a great blog on that exact scenario! https://medium.com/the-prefect-blog/event-driven-workflows-with-aws-lambda-2ef9d8cc8f1a