Hi all, I just got started on prefect (I mostly used AF before for orchestration) and it's great ❤️ Two quick questions:
• I was able to manually write Python code that runs my great expectations checkpoints - the GE built in task does not work with my
LegacyCheckpoint, and I wasn't able to make even a simple flow run (below). Did anybody get the GE integration work? Is that worth the trouble, when full "verbose" GE code to run validation is 4 lines of Python?
• I re-build the
DBT cloud client from AF to work as a Prefect task (two tasks really, scheduling the job, and polling DB cloud for the JOB status) - as I prefer DB cloud to DB shell locally installed. Is there any interest from the community in this sort of integration? If yes, happy to chat / share the simple POC I built.
GE CODE THAT DOES NOT WORK
from prefect import task, Flow, Parameter
from prefect.tasks.great_expectations import RunGreatExpectationsValidation
# Define checkpoint task
validation_task = RunGreatExpectationsValidation()
with Flow("ge_test") as flow:
validation_task(checkpoint_name='gitter_checkpoint')
flow.run()