Ralph Willgoss
10/20/2020, 3:43 PMRaphaël Riel
10/20/2020, 3:52 PM.map(letters)
on the task.Ralph Willgoss
10/20/2020, 4:13 PMRaphaël Riel
10/20/2020, 5:04 PMRalph Willgoss
10/20/2020, 5:26 PMemre
10/20/2020, 6:45 PMindividual_preprocessing
are not executed in parallel. I have no idea what causes it.
As @Raphaël Riel suggested, using mapping is your healthiest option to parallelize the same task over a list of inputs. Sadly, mapping of mappings isn’t a first class option yet.
You could do one of the mappings first, give the result to the second mapping with unmapped, and map over the second list. Return a list from the second mapped task, so you have a list of lists. Finally you can use flatten
to generate your expensive
task all possible combinations.
Let me wrap up a basic exampleRalph Willgoss
10/21/2020, 1:25 PM