Hi everyone,
Does someone know if it is possible to dynamically set task tags? For example, I have two flow runs with different parameters (Flow A and Flow B) but I want Flow A to use up different Dask resources than Flow B. (The Flow is similar but only the parameters change, so the tasks will also be the same tasks for each Flow)
k
Kevin Kho
09/30/2021, 2:34 PM
So there was someone here who posted recently how to parameterize DaskExecutor here . Maybe it’s worth a read?
But in general I don’t think you can achieve this without hacking it like he did.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.