https://prefect.io logo
#prefect-community
Title
# prefect-community
k

Klemen Strojan

07/21/2020, 5:31 AM
Hey all - I am a bit confused by this error, raised randomly by a scheduled flow:
Copy code
Failed to retrieve task state with error: ClientError([{'path': ['get_or_create_task_run'], 'message': 'Invalid ID', 'extensions': {'code': 'INTERNAL_SERVER_ERROR'}}])
Is this raised in GraphQL? What are the possible reasons? I am using Cloud + Core 0.12.1
z

Zachary Hughes

07/21/2020, 12:34 PM
Hi @Klemen Strojan! It does look like this was raised on the API side. If you can provide me with a timestamp and a timezone, I should be able to take a deeper look.
k

Klemen Strojan

07/21/2020, 12:44 PM
Hey @Zachary Hughes, the error was raised at 21 July 2020 080027 CEST. The flow was submitted for execution at 075932 CEST.
z

Zachary Hughes

07/21/2020, 12:53 PM
Thank you! I'm not seeing any immediate red flags in the logs. The error indicates that there was an issue retrieving the task and creating the task run-- are you seeing this deterministically, or was it a one-off?
k

Klemen Strojan

07/21/2020, 1:06 PM
There was a few of them over the last 24 hours. We had some network issues on our side, which could explain why there was an issue with creating the task run. Should we expect to see this error if for example the agent where the flow runs would be temporarily unavailable while the flow is running?
z

Zachary Hughes

07/21/2020, 1:39 PM
I wouldn't expect your agent's connectivity to cause this, no. But if your connectivity issues were cluster-wide (or wherever you're running your flows) that could have contributed to this.
FWIW, definitely keeping an eye on this on our side.
k

Klemen Strojan

07/21/2020, 1:45 PM
In our case if the agent is not reachable the same goes for the cluster. Thank you for now, I will let you know if there is anything new on our side.
z

Zachary Hughes

07/21/2020, 1:53 PM
Likewise. Thank you Klemen!
k

Klemen Strojan

07/23/2020, 11:35 AM
Hey @Zachary Hughes, I have a follow up on this issue. Is it possible for a scheduled flow to run on multiple agents at the same time, if all labels match?
z

Zachary Hughes

07/23/2020, 1:05 PM
Hi @Klemen Strojan, thank you for flagging this for us. We're working on an enhancement that will help us prevent this exact situation, and I'll be sure to let you know as soon as it's merged!
👍 1