Lina M
03/20/2025, 10:55 AMMarvin
03/20/2025, 10:55 AMmax_workers
for a ThreadPoolTaskRunner
in Prefect 3.x from the UI, you can leverage environment variables or configuration settings. Here's a concise breakdown:
1. Environment Variable: The ThreadPoolTaskRunner
uses the PREFECT_TASK_RUNNER_THREAD_POOL_MAX_WORKERS
environment variable to set the default number of workers if max_workers
is not explicitly provided. You can set this environment variable in your Prefect Cloud or Prefect Server UI under the "Advanced" settings for your deployment.
2. Configuration: If you prefer not to use environment variables, you can configure this setting in your Prefect configuration file. However, this would not be dynamically adjustable from the UI.
For more details, you can check the source code where the ThreadPoolTaskRunner
is defined. Unfortunately, there isn't a direct UI feature to set this dynamically per run, but using environment variables is a common workaround.
If you need further assistance on setting up environment variables in your deployment, feel free to ask!