Hey all - I am a bit confused by this error, raised randomly by a scheduled flow:

Failed to retrieve task state with error: ClientError([{'path': ['get_or_create_task_run'], 'message': 'Invalid ID', 'extensions': {'code': 'INTERNAL_SERVER_ERROR'}}])

Is this raised in GraphQL? What are the possible reasons? I am using Cloud + Core 0.12.1

Hi @Klemen Strojan! It does look like this was raised on the API side. If you can provide me with a timestamp and a timezone, I should be able to take a deeper look.

Hey @Zachary Hughes, the error was raised at 21 July 2020 080027 CEST. The flow was submitted for execution at 075932 CEST.

Thank you! I'm not seeing any immediate red flags in the logs. The error indicates that there was an issue retrieving the task and creating the task run-- are you seeing this deterministically, or was it a one-off?

There was a few of them over the last 24 hours. We had some network issues on our side, which could explain why there was an issue with creating the task run. Should we expect to see this error if for example the agent where the flow runs would be temporarily unavailable while the flow is running?

I wouldn't expect your agent's connectivity to cause this, no. But if your connectivity issues were cluster-wide (or wherever you're running your flows) that could have contributed to this.

In our case if the agent is not reachable the same goes for the cluster. Thank you for now, I will let you know if there is anything new on our side.

Likewise. Thank you Klemen!

Hey @Zachary Hughes, I have a follow up on this issue. Is it possible for a scheduled flow to run on multiple agents at the same time, if all labels match?

Hi @Klemen Strojan, thank you for flagging this for us. We're working on an enhancement that will help us prevent this exact situation, and I'll be sure to let you know as soon as it's merged!