Hey all, it seems the allow_failure() wrapper doesn’t work with the
DaskTaskRunner()
😢 It can’t pickle the task futures, which is sadly blocking our migration to 2.0. Have tried this both in Dask locally and also on k8s. Any ideas? MRE in 🧵
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.