Hi there prefect people! Here is a really weird issue which didn't seem to happen in the past, but now we've noticed it and we're not sure what to think of it. Here is a simple flow with simple tasks and mapping, but somehow the mapped output in the last task has a different length than the input, but everything is successful in the flow.
For example, if you check the image below, you can see the difference in number of outputs, but this is unexpected...
Here is the MWE for the simple flow: https://pastebin.com/1hGeYHjV
j
Jim Crist-Harif
03/31/2021, 4:51 PM
All tasks passed to map (including
upstream_tasks
) are assumed to be iterables that are mapped over. Since strings are iterables, you're accidentally mapping over the output of
I was aware of the existence of unmapped, but this one eluded me... I should've posted here hours ago.. Thanks a lot!! Can't believe I was iterating over the string..
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.