https://prefect.io
Join Slack
Say I’ve got two or more lists I’d like to map a task over. If I provide two mappable arguments to `...
# ask-community
e
Say I’ve got two or more lists I’d like to map a task over. If I provide two mappable arguments to 
Task.map()
it iterates through both of them together like 
zip()
. Is there a way to loop over every combination instead, like 
itertools.product()
?
k
You need a task to make that cross-product
e
so an un-mapped task taking both lists, that returns something like a list of tuples? And then I can map my other task over that?
I’ll have to figure out the destructuring but should be doable. Was hoping there was an easier way. Thanks for the quick reply!
k
Yes exactly. Try returning a tuple of lists and then use this syntax
Copy code
a, b = product()
other_task.map(a, b)
e
doesn’t that just put me back where I started?
tuple of lists vs list of tuples
k
I mean the 
a
and 
b
here will be expanded lists already like 
a=[1,1,1,2,2,2,3,3,3]
, 
b=["a","b",""c","a","b",""c","a","b",""c"]
. I dunno I might just be confusing you 😅. I think you understand it already
e
Ah, gotcha. Yes I guess that’d do it!
Copy code
In [14]: tuple(map(list, zip(*product(["A", "B", "C"], ["1", "2", "3"]))))
Out[14]:
(['A', 'A', 'A', 'B', 'B', 'B', 'C', 'C', 'C'],
 ['1', '2', '3', '1', '2', '3', '1', '2', '3'])
💪
k
Yeah exactly!
5 Views
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by