https://prefect.io logo
Title
r

Royzac

03/18/2022, 11:40 PM
Has anyone used Great Expectations, how does it compare to other testing frameworks?
k

Kevin Kho

03/18/2022, 11:44 PM
Let’s see what the community has to say. Am curious too what people are using.
a

Anna Geller

03/19/2022, 12:49 AM
Great Expectations is quite focused on working in Jupyter notebooks. If you need some resources about alternatives to running GE in a Jupyter notebook, check out: • Kevin's tutorial on Pandera -

video

+ code • My take on GE: blog
❤️ 1
👍 2
m

Matthias

03/19/2022, 8:42 AM
And how about Soda https://www.soda.io? It is new since last year (I think). Never used it, but I have been hearing a lot from it lately…
👀 1
:upvote: 2
If you use dbt, then dbt tests is also a valid options. There even is a some sort of port of GE to dbt https://github.com/calogica/dbt-expectations
👀 1
r

Royzac

03/29/2022, 12:39 AM
Is there anyway to do a "cascade" drop with to_sql("replace")?
k

Kevin Kho

03/29/2022, 1:07 AM
With Pandas? What do you mean by cascade drop?
a

Anna Geller

03/29/2022, 9:37 AM
@Royzac I'd say Pandas
to_sql("replace")
is a convenience method if you need to get things into a DB table quickly. But if you already have a table design with foreign keys, you shouldn't use it - you can always use append to load to a temporary table and then execute a MERGE query.