https://prefect.io logo
Title
i

Ismail Cenik

01/30/2023, 9:35 PM
Hello, I have been trying to migrate from v1 to v2. My flow has worked as expected except storing result in s3. The flow starts and waits during the task execution. When I kill the flow, I get the following error
r

redsquare

01/30/2023, 10:01 PM
can you thread the huge log so it doesn't take up the whole channel:)
i

Ismail Cenik

01/30/2023, 10:02 PM
task: <Task finished coro=<run.<locals>.wrapper() done, defined at /Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/anyio/_backends/_asyncio.py:278> exception=GatherIncomplete('Task is not complete. Results should not be retrieved until the task group exits.')>
Traceback (most recent call last):
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/asyncio/runners.py", line 43, in run
  return loop.run_until_complete(main)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/asyncio/base_events.py", line 566, in run_until_complete
  self.run_forever()
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/asyncio/base_events.py", line 534, in run_forever
  self._run_once()
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/asyncio/base_events.py", line 1735, in _run_once
  event_list = self._selector.select(timeout)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/selectors.py", line 558, in select
  kev_list = self._selector.control(None, max_ev, timeout)
KeyboardInterrupt

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/anyio/_backends/_asyncio.py", line 287, in wrapper
  return await func(*args)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/prefect/client/utilities.py", line 47, in with_injected_client
  return await fn(*args, **kwargs)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/prefect/engine.py", line 248, in create_then_begin_flow_run
  return await state.result(fetch=True)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/prefect/states.py", line 89, in _get_state_result
  raise await get_state_exception(state)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/prefect/engine.py", line 643, in orchestrate_flow_run
  flow_run_context.task_run_futures, client=client
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/prefect/engine.py", line 1557, in wait_for_task_runs_and_report_crashes
  states = await gather(*(future._wait for future in task_run_futures))
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/prefect/utilities/asyncutils.py", line 388, in gather
  return [tg.get_result(key) for key in keys]
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/prefect/utilities/asyncutils.py", line 388, in <listcomp>
  return [tg.get_result(key) for key in keys]
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/prefect/utilities/asyncutils.py", line 352, in get_result
  "Task is not complete. "
prefect.utilities.asyncutils.GatherIncomplete: Task is not complete. Results should not be retrieved until the task group exits.
Traceback (most recent call last):
 File "workflow.py", line 165, in <module>
  new_named_flow(kda_name, s3_flow_config_bucket)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/prefect/flows.py", line 452, in __call__
  return_type=return_type,
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/prefect/engine.py", line 168, in enter_flow_run_engine_from_flow_call
  return anyio.run(begin_run)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/anyio/_core/_eventloop.py", line 70, in run
  return asynclib.run(func, *args, **backend_options)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/anyio/_backends/_asyncio.py", line 292, in run
  return native_run(wrapper(), debug=debug)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/asyncio/runners.py", line 43, in run
  return loop.run_until_complete(main)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/asyncio/base_events.py", line 566, in run_until_complete
  self.run_forever()
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/asyncio/base_events.py", line 534, in run_forever
  self._run_once()
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/asyncio/base_events.py", line 1735, in _run_once
  event_list = self._selector.select(timeout)
 File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/selectors.py", line 558, in select
  kev_list = self._selector.control(None, max_ev, timeout)
KeyboardInterrupt