Mike B
03/01/2024, 9:35 PMMarvin
03/01/2024, 9:38 PMprefecthq/prefect:2-latest
, but additional package dependencies can be installed at runtime (Managed Execution - Prefect Docs).
It's also worth mentioning that if you need to use your own image, managed execution with the official Docker image might not be suitable, and another type of work pool may be recommended.
The tutorial section about workers also doesn't provide specifics on default resource constraints within Docker work pools, just the higher-level setup instructions (Work Pools and Workers - Prefect Docs).
The GitHub search didn't return any relevant open issues about Docker work pool resource limits.
Considering the information discovered, your issue may not be due to default resource limits set by Prefect. It could be related to the actual configuration of the Docker container or the Docker daemon on the host system.
You might want to inspect the Docker daemon's configs to ensure it's not limiting CPU resources for containers. Additionally, ensure that your dbt project configuration is aligned with the Docker settings. Furthermore, reviewing Docker's own resource allocation settings, such as CPU quotas and periods for the container, might provide clarity. If you're still unable to resolve the issue, it might be beneficial to directly reach out to Prefect's support or community channels for guidance.