Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Upgrading from 0.13.19 to the latest version rocked!  One flow in particular went from 35 minutes to 6 minutes.  Just out of curiosity, what might have caused that huge speedup?  Curious as to what went on under the hood between 0.13.19 and 0.14.12!

It was definitely an I/O bound task, with some out-of-memory needs.

It seems possible it was a Dask improvement! We didn't make any performance focused changes in Core that I know of. Here's the changelog :slightly_smiling_face: <https://github.com/PrefectHQ/prefect/blob/master/CHANGELOG.md>