Hi Everyone, I'm trying to create a scheduled run of Kedro and there is an existing source code for generating the flow. Here is the link of it https://docs.kedro.org/en/stable/deployment/prefect.html. Now I'm wondering how I can orchestrate it with prefect on a cloud-native applications.
t
Tess Dicker
11/09/2023, 3:13 PM
hey Eluard! Would you be able to provide some more context -- what are you using Kedro for/which cloud native application are you planning on using?
e
Eluard
11/10/2023, 3:37 AM
I'm using kedro for data ingestion, now since new data are added every day, I want prefect to schedule a run for the kedro pipeline every week. I was able deploy my kedro pipeline on zeet and was running for a week to fetch and store data into postgres database.
t
Tess Dicker
11/10/2023, 4:30 PM
At this point, the best recommendation is to use Prefect cloud. You won't have to manage Prefect server. Attaching some documentation here: https://docs.prefect.io/2.14.3/cloud/.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.