Hi folks,
It is possible to map a task that is using a
LOOP
signal. If I have a task that calls an API, and has to loop until it has no more data to fetch, can put pass each iteration of the call to a downstream task like so:
Copy code
results = transform_data.map(call_api())
Inside
call_api
I am using a
LOOP
signal. But I cannot seem to access the loop results in the next task
transform_data
. My understanding was that when using this construct, each iteration of the task was it's own task.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.