Hello. I’d like to raise the issue of changes in recent prefect versions, that break our deployment. It seems that if Prefect core + server + docker image versions aren’t synchronised to the exact patch version (e.g 0.13.13 might not work with 0.13.17), things might break down. Usually “patch” versions should not include any breaking change. In order for us to make sure our production flows won’t break, we have to make sure that we use specific version across the board. fetching the latest docker image or the latest prefect core version is not something one should do in production, unless one makes sure to also update his Prefect Server (which might not be possible or required in production environments. attached is the latest error we received out of the blue, but this is not the first time we experience a breaking change.

Unexpected error: ClientError('400 Client Error: Bad Request for url: <http://10.0.4.45:4200/graphql>\n\nThis is likely caused by a poorly formatted GraphQL query or mutation. GraphQL sent:\n\nquery {\n    mutation($input: create_task_run_artifact_input!) {\n            create_task_run_artifact(input: $input) {\n                id\n        }\n    }\n}\nvariables {\n    {"input": {"task_run_id": "5b4f7865-b192-462e-a9ee-753e243db30a", "kind": "link", "data": {"link": "/default/flow-run/4fc7c743-787f-49f7-b3dc-31cfc2fa720f"}, "tenant_id": null}}\n}')
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/prefect/engine/runner.py", line 48, in inner
    new_state = method(self, state, *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/prefect/engine/task_runner.py", line 856, in get_task_run_state
    value = prefect.utilities.executors.run_task_with_timeout(
  File "/usr/local/lib/python3.8/site-packages/prefect/utilities/executors.py", line 298, in run_task_with_timeout
    return task.run(*args, **kwargs)  # type: ignore
  File "/usr/local/lib/python3.8/site-packages/prefect/utilities/tasks.py", line 449, in method
    return run_method(self, *args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/prefect/tasks/prefect/flow_run.py", line 173, in run
    create_link(urlparse(run_link).path)
  File "/usr/local/lib/python3.8/site-packages/prefect/artifacts.py", line 31, in create_link
    return client.create_task_run_artifact(
  File "/usr/local/lib/python3.8/site-packages/prefect/client/client.py", line 1689, in create_task_run_artifact
    result = self.graphql(
  File "/usr/local/lib/python3.8/site-packages/prefect/client/client.py", line 296, in graphql
    result = <http://self.post|self.post>(
  File "/usr/local/lib/python3.8/site-packages/prefect/client/client.py", line 211, in post
    response = self._request(
  File "/usr/local/lib/python3.8/site-packages/prefect/client/client.py", line 433, in _request
    response = self._send_request(
  File "/usr/local/lib/python3.8/site-packages/prefect/client/client.py", line 365, in _send_request
    raise ClientError(msg)
prefect.utilities.exceptions.ClientError: 400 Client Error: Bad Request for url: <http://10.0.4.45:4200/graphql>

This is likely caused by a poorly formatted GraphQL query or mutation. GraphQL sent:

query {
    mutation($input: create_task_run_artifact_input!) {
            create_task_run_artifact(input: $input) {
                id
        }
    }
}
variables {
    {"input": {"task_run_id": "5b4f7865-b192-462e-a9ee-753e243db30a", "kind": "link", "data": {"link": "/default/flow-run/4fc7c743-787f-49f7-b3dc-31cfc2fa720f"}, "tenant_id": null}}
}

Hi Roey, Apologies for the rough experience you're having here. Our current policy for

prefect-server

deployments is that the version of

prefect-server

should always be >= the version of

prefect

deployed (

prefect-server

is backwards-compatible with

prefect

, but not the other way around). Prefect is a rapidly developed library, with new apis being added to the backend to support new features all the time. We're unlikely to add a more rigorous process around mutual-backwards-compatibility as it would lead to a slower development cycle for us. The only "officially supported" version of

prefect-server

is a local deployment using

prefect server start

(which implies that all versions match). Deployments outside this scope are unsupported (though we'll still try to answer questions and resolve bugs), and assume that the user takes on the burden of handling smooth upgrades. In summary: -

prefect-server >= prefect

should always work -

prefect-server < prefect

might work, but isn't guaranteed and is unsupported.

thanks for the clarification.