<@ULVA73B9P> using a k3s workpool I get The node was low on resource: ephemeral-storage. Threshold q...
m
@Marvin using a k3s workpool I get The node was low on resource: ephemeral-storage. Threshold quantity: 2071484651, available: 1874084Ki. Container prefect-job was using 3122900Ki, request is 0, has larger consumption of ephemeral-storage. How can I avoid that?
m
To avoid the issue of running out of ephemeral storage with your k3s work pool in Prefect, you can consider the following approaches: 1. Custom Job Template: You can configure a custom job template to manage the manifest workers for flow execution. This allows you to set resource requests and limits to ensure that sufficient ephemeral storage is available. Refer to the Kubernetes Worker documentation for advanced configuration examples. 2. Storage Configuration: Ensure that your flow code storage is properly configured. Prefect supports remote storage options such as S3 or Google Cloud Storage, which can help manage large amounts of data more effectively than local ephemeral storage. For more details, review the Storage documentation. For further reference, see: - Work Pools: Work pools documentation - Storage: Storage concepts If the issue persists or if you have specific configurations you need help with, feel free to provide additional details!