https://prefect.io logo
Title
i

itay livni

04/01/2020, 2:49 AM
Hi - I am looking for guidance on deploying a simple E,T,L
Flow
with a schedule to run once a day at a specific time on the cloud (AWS). The size of the data is sub 1 mb. Should the ETL flow have a scheduler? -- Thanks in advance.
n

nicholas

04/01/2020, 3:08 AM
Hi @itay livni! Prefect is a natural for this. For deployment and scheduling, Prefect Cloud offers a Hybrid solution in which your data and your flow's execution runs on your infrastructure but you can leave the scheduling up to us. We have a great tutorial that will walk you through doing just that - writing an ETL flow that you can run on your infrastructure but leave the scheduling up to us. Here's the tutorial: https://docs.prefect.io/core/tutorial/01-etl-before-prefect.html. To sign up for a free Scheduler account, you can visit cloud.prefect.io 🙂
i

itay livni

04/01/2020, 3:28 AM
@nicholas Ok. I saw that. And very good to know that is what I should be following 🙂 How does the lambda get invoked ? The example does not take you to deployment as far as I can tell.
n

nicholas

04/01/2020, 3:30 AM