@Marvin Is there a recommended docker-compose.yml file that we should use if we want to run prefect core on our own infrastructure?

Prefect 2.x (referred to as Prefect Core in the context of the Prefect 1.x versioning) does not provide a specific

docker-compose.yml

file as a one-size-fits-all solution since deployment can vary significantly based on individual requirements and infrastructure. However, the Prefect documentation provides guidance on using Docker, especially on how to communicate with the Prefect API from within a Docker container. When you run your Prefect flows inside a Docker container, you'll need to ensure that the container can communicate with the Prefect API. Typically, you would set the

PREFECT_API_URL

environment variable to point to your Prefect API instance. For example, if you're running on macOS or Windows, you can use:

shell
PREFECT_API_URL=<http://host.docker.internal:4200/api>

If you're running on Linux, the setting would be:

shell
PREFECT_API_URL=<http://localhost:4200/api>

And you would use the

--network="host"

option:

shell
docker run --network="host" -e PREFECT_API_URL=<http://localhost:4200/api> your-prefect-docker-image

For a more detailed and customized setup, you would need to refer to the Prefect documentation on deploying flows with Docker. This involves building a Docker image with your flow code embedded, configuring network settings per your environment, and potentially using orchestration tools like Kubernetes for deployment. You can build upon this information to create a

docker-compose.yml

file tailored to your infrastructure. Such a file would define services, including at least one for running the Prefect agent (which may need the API URL as an environment variable) and any other necessary infrastructure services like databases or message queues, depending on your Prefect deployment architecture. For further assistance or to review the recommended practices, it's advisable to visit the Prefect documentation on Docker, which provides examples and in-depth guidance. Here is the source for that information: Running Flows with Docker.