Hey I m trying to use the `LOOP` and write the results on ea

Question

Hey I m trying to use the `LOOP` and write the results on each iteration as documented However it doesn t seem to work It only writes the last iteration ``` task def log output result logger = prefect context get logger result task result=LocalResult dir= results location= test task loop count prefect def loop test loop payload = prefect context get task loop result n = loop payload get n 1 print n if n gt 5 return n raise LOOP f Iteration n result=dict n=n+1 with Flow Postgres gt BigQuery as flow x = loop test log output x ``` See output logging and diagnostics in thread

Joël Luijmes · Answer

``` 2020 11 05 07 11 07 INFO prefect FlowRunner | Beginning Flow run for Postgres gt BigQuery 2020 11 05 07 11 07 DEBUG prefect FlowRunner | Using executor type LocalExecutor 2020 11 05 07 11 07 DEBUG prefect FlowRunner | Flow Postgres gt BigQuery Handling state change from Scheduled to Running 2020 11 05 07 11 07 INFO prefect TaskRunner | Task loop test Starting task run 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Pending to Running 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Calling task run method 1 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Running to Looped 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Pending to Running 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Calling task run method 2 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Running to Looped 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Pending to Running 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Calling task run method 3 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Running to Looped 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Pending to Running 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Calling task run method 4 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Running to Looped 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Pending to Running 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Calling task run method 5 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Running to Looped 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Pending to Running 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Calling task run method 6 2020 11 05 07 11 07 DEBUG prefect LocalResult | Starting to upload result to test 6 prefect 2020 11 05 07 11 07 DEBUG prefect LocalResult | Finished uploading result to Users joell joell dev Scraper scraper next prefect sync results test 6 prefect 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task loop test Handling state change from Running to Success 2020 11 05 07 11 07 INFO prefect TaskRunner | Task loop test Finished task run for task with final state Success 2020 11 05 07 11 07 INFO prefect TaskRunner | Task log output Starting task run 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task log output Handling state change from Pending to Running 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task log output Calling task run method 2020 11 05 07 11 07 INFO prefect log output | 6 2020 11 05 07 11 07 DEBUG prefect TaskRunner | Task log output Handling state change from Running to Success 2020 11 05 07 11 07 INFO prefect TaskRunner | Task log output Finished task run for task with final state Success 2020 11 05 07 11 07 INFO prefect FlowRunner | Flow run SUCCESS all reference tasks succeeded 2020 11 05 07 11 07 DEBUG prefect FlowRunner | Flow Postgres gt BigQuery Handling state change from Running to Success config overrides env vars PREFECT LOGGING LEVEL PREFECT CONTEXT SECRETS POSTGRES PREFECT CONTEXT SECRETS GCP CREDENTIALS PREFECT FLOWS CHECKPOINTING flow information environment executor true labels true logger true metadata image true on exit false on start false type LocalEnvironment result type LocalResult schedule storage flows Postgres gt BigQuery true labels false add default labels true directory true flows Postgres gt BigQuery true path false result true secrets false stored as script false type Local task count 2 system information platform macOS 10 15 7 x86 64 i386 64bit prefect backend server prefect version 0 13 13 python version 3 8 6 ```

nicholas · Answer

Hi < Joël Luijmes> thanks for reporting this I can confirm each iteration of the loop is overwriting the previous result as despite a templated location being present this holds true for strings and callables on the location kwarg

nicholas · Answer

< Marvin> open Templated results are overwritten on raised LOOP

Marvin · Answer