t

    Trevor Kramer

    1 year ago
    Is there any way to see in the cloud ui what executor the flow is registered with? I'm not seeing the task concurrency I am expecting and want to confirm the executor settings.
    Kevin Kho

    Kevin Kho

    1 year ago
    Hi @Trevor Kramer, I'll double check tomorrow but it doesn't seem there is a way unfortunately. What issues with task concurrency are you seeing?
    t

    Trevor Kramer

    1 year ago
    I have a mapped task with 20 segments and they are executing sequentially. I am configuring the executor this way.
    flow.executor = DaskExecutor(cluster_kwargs={
        'n_workers': 10
    })
    flow.register(project_name=project, labels=labels, idempotency_key=idempotency_key, no_url=True)
    Kevin Kho

    Kevin Kho

    1 year ago
    Is it 1 mapped task with 20 different inputs? Or you do mean a mapped task that goes 20 tasks deep?
    And you have no parallelization at all? do you see the same behavior with LocalDaskExecutor?
    t

    Trevor Kramer

    1 year ago
    1 mapped task with 20 inputs
    i'm testing the LocalDaskExecutor now
    Kevin Kho

    Kevin Kho

    1 year ago
    Might need to remove the idempotency key for a bit
    t

    Trevor Kramer

    1 year ago
    Is there a way to send you a file privately? I have a log file which shows the behavior
    Kevin Kho

    Kevin Kho

    1 year ago
    Yep DM me.