Connor Martin

    Connor Martin

    9 months ago
    Hey all, I'm probably making this much harder than it should be, but how do I restart a flow in the UI with the exact same parameters without any task result cacheing? I've turned checkpointing off on all of my tasks and I've even expanded
    merge()
    to allow me to pass kwargs to the
    Merge
    constructor so I can turn off that task checkpointing, but it still picks up in the middle of my flow at the task that failed. I can't have this happen because it requires previously downloaded data referenced in other tasks that get cleaned on failure/success. My question is: How can I restart a flow in the UI from the beginning with the exact same parameters without any task result caching?
    Kevin Kho

    Kevin Kho

    9 months ago
    Hello @Connor Martin, this feature doesn’t exist yet but we have had discussions about providing a dropdown of parameter sets to kick off a new flow run. But in the mean time, we don’t have such a feature
    Connor Martin

    Connor Martin

    9 months ago
    Hey @Kevin Kho thanks for the quick response. Ahhh so there's no way to restart a flow just as it is from the beginning? What do you mean by a dropdown of parameter sets?
    Kevin Kho

    Kevin Kho

    9 months ago
    A lot of users just want a non technical person to go in and select previously run parameter sets to kick off a new flow run. Think for report generation
    You can set the states of the tasks from Success to Scheduled maybe and then trigger a restart
    Connor Martin

    Connor Martin

    9 months ago
    Doesn't turning off checkpointing cause the result of a task to no longer be stored? Shouldn't that mean that the flow bubbles back up to the beginning of the dag? I'll go give setting the state a try as well, thank you for the suggestion!
    Kevin Kho

    Kevin Kho

    9 months ago
    But you need to re-register the Flow for turning off checkpointing to apply so it won’t apply on the previous flow run
    Connor Martin

    Connor Martin

    9 months ago
    I have reregistered and manually started a flow run where I set the state of the flow to failed.
    Kevin Kho

    Kevin Kho

    9 months ago
    Do you have a
    target
    set up for the task?