Hey, just wanted to post an open-source tool that ...
# show-and-tell
i
Hey, just wanted to post an open-source tool that I’ve been working on. While working with Prefect, I found that I don’t have any context about the data in my pipelines, can’t easily test the data in the pipelines, and only know if the pipeline is successful or not. So I built panda-patrol 🐼 which allows you to monitor each node in your DAG, use AI to generate tests for your data, test data within your pipelines, store data profiles, and more. All with this comes with dashboards and alerts. You can easily drop it into your Prefect DAGs (or any other Python-based data flow) and just run your pipelines are you normally would — but with monitoring and more context. Currently floating this around to see if its useful. Give it a try here: https://panda-patrol.vercel.app/
🙌 3
🐼 1