I am wondering if anyone has ever experienced a "reduce" bottleneck using prefect. I have a procedure which consumes thousands of mapped tasks. The task itself is very simple, but it just hangs for a very long time. Does anyone have leads for what might be the issue.
m
Marwan Sarieddine
10/21/2020, 8:50 PM
Hi @Vincent - we might be experiencing something similar, meant to look into the logs and further inspect this before raising an issue - will hopefully provide a follow up update if it turns out to be the case
v
Vincent
10/21/2020, 10:34 PM
Please let me know if you find a solution or start a Issue.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.