Hello all I m having difficulties figuring out what this err Prefect Community #ask-community

Hello all, I'm having difficulties figuring out wh...

Ifeanyi Okwuchi

07/07/2022, 8:00 PM

Hello all, I'm having difficulties figuring out what this error means

Copy code

Unexpected error: KeyError(0)
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/prefect/engine/runner.py", line 48, in inner
    new_state = method(self, state, *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/prefect/engine/flow_runner.py", line 569, in get_flow_run_state
    executors.prepare_upstream_states_for_mapping(
  File "/usr/local/lib/python3.8/site-packages/prefect/utilities/executors.py", line 682, in prepare_upstream_states_for_mapping
    value = upstream_state.result[i]
KeyError: 0

Ifeanyi Okwuchi

07/07/2022, 8:05 PM

When I look through the logs on GCP, it says

Copy code

INFO:prefect.CloudTaskRunner:Task 'set_conductor_config': Starting task run...
2022-07-07 15:35:05.521 EDT
[2022-07-07 19:35:05+0000] INFO - prefect.CloudTaskRunner | Task 'set_conductor_config': Finished task run for task with final state: 'Mapped'
INFO:prefect.CloudTaskRunner:Task 'set_conductor_config': Finished task run for task with final state: 'Mapped'
[2022-07-07 19:35:05+0000] INFO - prefect.LocalDaskExecutor | Attempting to interrupt and cancel all running tasks...
INFO:prefect.LocalDaskExecutor:Attempting to interrupt and cancel all running tasks...
2022-07-07 15:35:05.524 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.524 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 78, in _worker
2022-07-07 15:35:05.524 EDT

workerpool0-0
 work_item = work_queue.get(block=True)
2022-07-07 15:35:05.524 EDT

workerpool0-0
KeyboardInterrupt
2022-07-07 15:35:05.525 EDT

workerpool0-0
CRITICAL:concurrent.futures:Exception in worker
2022-07-07 15:35:05.525 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.525 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 78, in _worker
2022-07-07 15:35:05.525 EDT

workerpool0-0
 work_item = work_queue.get(block=True)
2022-07-07 15:35:05.525 EDT

workerpool0-0
KeyboardInterrupt
2022-07-07 15:35:05.525 EDT

workerpool0-0
CRITICAL:concurrent.futures:Exception in worker
2022-07-07 15:35:05.526 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.526 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 78, in _worker
2022-07-07 15:35:05.526 EDT

workerpool0-0
 work_item = work_queue.get(block=True)
2022-07-07 15:35:05.526 EDT

workerpool0-0
KeyboardInterrupt
2022-07-07 15:35:05.526 EDT

workerpool0-0
CRITICAL:concurrent.futures:Exception in worker
2022-07-07 15:35:05.526 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.526 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 78, in _worker
2022-07-07 15:35:05.526 EDT

workerpool0-0
 work_item = work_queue.get(block=True)
2022-07-07 15:35:05.526 EDT

workerpool0-0
KeyboardInterrupt
2022-07-07 15:35:05.526 EDT

workerpool0-0
CRITICAL:concurrent.futures:Exception in worker
2022-07-07 15:35:05.526 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.526 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 78, in _worker
2022-07-07 15:35:05.526 EDT

workerpool0-0
 work_item = work_queue.get(block=True)
2022-07-07 15:35:05.526 EDT

workerpool0-0
KeyboardInterrupt
2022-07-07 15:35:05.527 EDT

workerpool0-0
CRITICAL:concurrent.futures:Exception in worker
2022-07-07 15:35:05.527 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.527 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 78, in _worker
2022-07-07 15:35:05.527 EDT

workerpool0-0
 work_item = work_queue.get(block=True)
2022-07-07 15:35:05.527 EDT

workerpool0-0
KeyboardInterrupt
2022-07-07 15:35:05.527 EDT

workerpool0-0
CRITICAL:concurrent.futures:Exception in worker
2022-07-07 15:35:05.527 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.527 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 78, in _worker
2022-07-07 15:35:05.527 EDT

workerpool0-0
 work_item = work_queue.get(block=True)
2022-07-07 15:35:05.527 EDT

workerpool0-0
KeyboardInterrupt
2022-07-07 15:35:05.528 EDT

workerpool0-0
CRITICAL:concurrent.futures:Exception in worker
2022-07-07 15:35:05.528 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.528 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 78, in _worker
2022-07-07 15:35:05.528 EDT

workerpool0-0
 work_item = work_queue.get(block=True)
2022-07-07 15:35:05.528 EDT

workerpool0-0
KeyboardInterrupt
2022-07-07 15:35:05.528 EDT

workerpool0-0
CRITICAL:concurrent.futures:Exception in worker
2022-07-07 15:35:05.528 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.528 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 78, in _worker
2022-07-07 15:35:05.528 EDT

workerpool0-0
 work_item = work_queue.get(block=True)
2022-07-07 15:35:05.528 EDT

workerpool0-0
KeyboardInterrupt
2022-07-07 15:35:05.648 EDT

workerpool0-0
[2022-07-07 19:35:05+0000] ERROR - prefect.CloudFlowRunner | Unexpected error: KeyError(0)
2022-07-07 15:35:05.648 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.648 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/site-packages/prefect/engine/runner.py", line 48, in inner
2022-07-07 15:35:05.648 EDT

workerpool0-0
 new_state = method(self, state, *args, **kwargs)
2022-07-07 15:35:05.648 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/site-packages/prefect/engine/flow_runner.py", line 569, in get_flow_run_state
2022-07-07 15:35:05.648 EDT

workerpool0-0
 executors.prepare_upstream_states_for_mapping(
2022-07-07 15:35:05.648 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/site-packages/prefect/utilities/executors.py", line 682, in prepare_upstream_states_for_mapping
2022-07-07 15:35:05.648 EDT

workerpool0-0
 value = upstream_state.result[i]
2022-07-07 15:35:05.648 EDT

workerpool0-0
KeyError: 0
2022-07-07 15:35:05.648 EDT

workerpool0-0
ERROR:prefect.CloudFlowRunner:Unexpected error: KeyError(0)
2022-07-07 15:35:05.648 EDT

workerpool0-0
Traceback (most recent call last):
2022-07-07 15:35:05.648 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/site-packages/prefect/engine/runner.py", line 48, in inner
2022-07-07 15:35:05.648 EDT

workerpool0-0
 new_state = method(self, state, *args, **kwargs)

2022-07-07 15:35:05.648 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/site-packages/prefect/engine/flow_runner.py", line 569, in get_flow_run_state
2022-07-07 15:35:05.648 EDT

workerpool0-0
 executors.prepare_upstream_states_for_mapping(
2022-07-07 15:35:05.648 EDT

workerpool0-0
 File "/usr/local/lib/python3.8/site-packages/prefect/utilities/executors.py", line 682, in prepare_upstream_states_for_mapping
2022-07-07 15:35:05.648 EDT

workerpool0-0
 value = upstream_state.result[i]
2022-07-07 15:35:05.648 EDT

workerpool0-0
KeyError: 0

Kevin Kho

07/07/2022, 8:12 PM

I think you might be passing uneven lists to a mapped tasks or maybe you have a downstream task that is not mapped but sets a mapped task as upstream?

Ifeanyi Okwuchi

07/07/2022, 9:38 PM

Ah I see.

product_category_variables

is a single output that wasn't mapped. changing that to

unmapped(product_category_variables)

should fix it right?

Copy code

conductor_config_set = set_conductor_config.map(
        cfg=final_config,
        config_path=unmapped(config_path),
        dataset_path=dataset_paths,
        upstream_tasks=[unmapped(add_dumbo_features), product_category_variables],

Kevin Kho

07/07/2022, 9:59 PM

I think so

3 Views

Open in Slack

Previous Next