https://prefect.io logo
#prefect-community
Title
# prefect-community
e

Eden

11/24/2022, 7:16 AM
quick question šŸ™šŸ» I built a work queue for Concurrency:
unlimited
It works perfectly fine. However, when I modify Concurrency into, for example, 3 It failed to run jobs šŸ˜ž
I only found log in agent
Copy code
ā”‚ httpx.LocalProtocolError: Invalid input ConnectionInputs.RECV_PING in state ConnectionState.CLOSED                                                                                                       ā”‚
ā”‚ 07:46:36.643 | ERROR   | prefect.agent - Invalid input ConnectionInputs.SEND_HEADERS in state ConnectionState.CLOSED                                                                                     ā”‚
ā”‚ Traceback (most recent call last):                                                                                                                                                                       ā”‚
ā”‚   File "/usr/local/lib/python3.9/site-packages/h2/connection.py", line 224, in process_input                                                                                                             ā”‚
ā”‚     func, target_state = self._transitions[(self.state, input_)]                                                                                                                                         ā”‚
ā”‚ KeyError: (<ConnectionState.CLOSED: 3>, <ConnectionInputs.SEND_HEADERS: 0>)                                                                                                                              ā”‚
ā”‚                                                                                                                                                                                                          ā”‚
ā”‚ During handling of the above exception, another exception occurred:
Or I misunderstand the usage of the concurrent usage.
m

Mason Menges

11/28/2022, 4:32 PM
Hey @Eden Could you provide some more info about the flow that triggered this error? Specifically a minimum reproducible example of the flow code, Any additional flow configurations (task runner, retries configured, etc/)
e

Eden

11/29/2022, 2:20 AM
@Mason Menges thanks for the reply. It fixed after setting to 20.
3 and 10 will lead to the failed outcome
Specifically, work queue will show failed and jobs stay pending. --------------------------------------------------------------------------- No jobs created in k8s. I could only find the error log like the head of the thread. --------------------------------------------------------------------------- In terms of 20 passing case, is that anything I should learn about setting this figure? Thank you very much šŸ™‡šŸ»ā€ā™‚ļø
4 Views