Hey everyone, is there a way to use a FilterTask and rely on the output of two different tasks in the filter_func? I build a workaround where I combine the data I want to filter with the additional information, that feels really clunky however. I added some pseudo code to ilustrate my workaround
Copy code
with Flow("filtering") as flow:
a_s = get_a_s() # ["a1", "a2", "a3"]
b = get_b() # "b2"
a_s_and_b = combine_a_s_and_b.map(a_s = a_s, b = unmapped(b)) # [("a1", "b2"), ("a2", "b2"), ("a3", "b2")]
FilterTask(filter_func=a_and_b_end_on_the_same_character)(a_s_and_b) # [("a2", "b2")]
n
nicholas
08/27/2021, 3:08 PM
Hi @Bastian Röhrig - if you need to combine results, it looks like you'll need some intermediary task regardless, especially because it looks like you're creating tuples to compare
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.