Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi everyone.  I've only just discovered Prefect.  It looks pretty promising.
Before I commit a large amount of time to learn everything about it, I'd like to ask a quick question.
I've been using pydoit for years and really like it's ability to use file md5 signatures to know if a task is up-to-date and for build-avoidance.
Can the same kind of capability be developed with Prefect?

Prefect has strong versioning of metadata for flows, but otherwise will always pull the most up to date versions from your storage mechanism. Although, if you want more advanced tracking of things like file hashes, I think the technical preview of Prefect Orion has capabilities for just that.

Welcome to the Community, <@U02J2PTNBK3> :smile: