Hi community, does anyone have a cool Prefect + Great Expectations use case? Looking for an example to include in a blog.
a
Andrew Huang
03/30/2022, 3:46 PM
A thought is a weather forecast data assimilation (ingesting weather data for a weather model). Sometimes, observational data goes awry due to the instrument growing old and miscalibrated, or external sources such as airplane causing a gust leading to extraneously high wind speeds measured
k
Kevin Kho
03/30/2022, 3:50 PM
Ask @Niels Prins
a
Anna Geller
03/30/2022, 4:02 PM
cc @Matthias tagging in case you have something shareable 🙂
m
Matthias
03/30/2022, 5:07 PM
Well, I don't have any datasets that you could use. But we use GE for validating our outputs right before we publish them to other systems that require the outputs. Having the GE output visible from the Prefect UI (as an artifact) is super useful for debugging
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.