Alex Joseph
12/03/2020, 8:06 PMtarget
option, but I don't seem to be seeing any option to add the function arguments to template the output.
For example, I'd like to have:
@task(target="{single_pattern}_{config['a']}.txt", checkpoint=True, result=LocalResult(dir="cache/"), )
def run_spark_job(single_pattern, config):
...
I can template parameters, date etc, but I don't seem to have way to template the arguments themselves. What's the correct way to handle this situation? Thanks 🙂Zanie
Alex Joseph
12/04/2020, 5:14 AM