Good day ! noticed that while executing a flow, the delay in transitioning from an upstream task to a downstream task is about 10 seconds. Is there some way to lessen this delay? Deployed local prefect server. Server resources are not used at all. a local agent is used, with an executor on the dask cluster.
n
nicholas
08/21/2020, 10:31 PM
Hm, that’s pretty suspicious, the delay between tasks should be milliseconds... there might something else going on outside Cloud
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.