Tom Shaffner

    Tom Shaffner

    9 months ago
    If tasks are mapped in the complex way like https://docs.prefect.io/core/concepts/mapping.html#complex-mapped-pipelines, does something else need to be done to get them to cache?
    Kevin Kho

    Kevin Kho

    9 months ago
    I think in general, when you use mapping, you need to template the location of the result so that each mapped task gets a separate file. Or you are you talking about
    cache_for
    and
    cache_validator
    ?
    Also the
    apply_map
    is just a function that adds tasks to your Flow so it should be those tasks that have checkpointing
    Tom Shaffner

    Tom Shaffner

    9 months ago
    I was talking about the
    cache_for
    , sounds like templating is the way to go.
    Kevin Kho

    Kevin Kho

    9 months ago
    I think templating should help you split out the files yep