hi! I have a Task that is querying a slow API (10K times). I want to checkpoint this task each iteration (disk is okay), but struggling with how to template the
location
since the task argument is what makes the task unique, but that’s not available to the context object as far as I can tell. Am I missing something obvious for this use case?
c
Chris White
02/02/2021, 2:14 AM
Hi Josh! Task inputs are also available for location templating, e.g.,
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.