@Marvin I am trying to start a worker on a process work pool but get this exception:

File "/home/netanel/.cache/pypoetry/virtualenvs/upstream-data-engineering-ptQzHj37-py3.10/lib/python3.10/site-packages/httpx/_models.py", line 762, in json
    return jsonlib.loads(self.content, **kwargs)
  File "/usr/lib/python3.10/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3.10/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/lib/python3.10/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

It appears that you're encountering a

JSONDecodeError

due to a response that is not valid JSON. From what I found, there are a couple of GitHub issues reported about similar errors. One such issue describes a

JSONDecodeError

when using

OrionClient.read_work_queue_by_name(queue_name)

and receiving an HTML response instead of JSON. Another issue mentions a

JSONDecodeError

when trying to create a work pool using the CLI, which also seems to be related to processing a non-JSON response. Please refer to these issues and follow the discussions or any proposed solutions/workarounds. If these issues don't resemble your exact scenario or if the solutions provided there don't work for you, consider providing additional information and possibly open a new issue on the Prefect GitHub repository to get assistance from the developers or the community.

@Marvin I am running it using:

prefect work-pool create test_pool --provision-infra

When the prefect is running inside a docker

When running Prefect work pools with Docker, you might not find direct commands in the documentation for the exact

prefect work-pool create test_pool --provision-infra

syntax. However, there are guides related to working with work pools and deploying flows using different types of work pools, such as the Push Work Pool guide, which might be relevant when dealing with serverless computing infrastructure. For a typical use of work pools with Docker, you might need to specify the Docker image to use when deploying. You can find information on how to inspect and update work pools with the Prefect CLI in the work pools concepts documentation. Since you mentioned running Prefect inside Docker and using the

--provision-infra

flag specifically, which may relate to provisioning infrastructure automatically, this might be something not directly documented or might require checking the exact implementation details and prerequisites for such an option within Prefect. If this does not resolve your issue or you need more specific guidance, consider reaching out to the Prefect community or opening a GitHub issue for clarifications on usage with Docker and infrastructure provisioning.