hi all! we are really new to this type of technology like Prefect. Our aim is to build a comparison service for niche and we have dosens of csv product feeds which we have to read, import to databse and during improting also normalize . My understanding is that we can use Prefect to make this part if the process more organised. Do you think prefect is the right tool for such a task?
d
Dylan
02/22/2021, 4:21 PM
Hello Gelinger Media!
Most definitely! Your usecase sounds like one that python is well-equipped for. Prefect would be an excellent tool to help you make sure that your workflow (likely a periodic data refresh) is scheduled and observable
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.