TL;DR I’m seeking a source for converting AirFlow to Prefect.
Hi All. I have inherited what amounts to an AirFlow demo that I would like to sort out how to convert over to a Prefect demo. I am a graduate student in a practicum and the previous cohort wrote the AF stuff. Now I am trying to answer the question as to whether AF should remain in place or if Prefect could possibly be snapped in AF’s place before the project gets truly up and running. As a point of reference, I did get a Prefect Cloud demo type of thing up and running last week (it just spun up a container in AWS and spit some stuff out in the Prefect logs). So I’m not a complete newb, but my background is more on the networking than the development side.
k
Kevin Kho
06/22/2021, 9:01 PM
Hey @Scott Vermillion, I haven’t seen such a resource myself yet. We welcome the community to chime in. If you have a specific question like, “how would i do this?“, that is something we can definitely help with.
z
Zach Schumacher
06/22/2021, 9:12 PM
really i think the core concepts are a DAG -> Flow and Operator -> Task. From there its just porting your code over.
s
Scott Vermillion
06/23/2021, 5:43 PM
OK, thanks much all. I will try my hand at something easy and check back with the community if I get hung up. I feel like this shouldn’t be too hard since things haven’t progressed very far in the broader context of the project. The downside here is that I’m likely going to need to spin up on AF a little better before I can port it.