Blake
03/11/2024, 11:21 PMMarvin
03/11/2024, 11:21 PMDaskTaskRunner
or the RayTaskRunner
, you can specify in a flow decorator to run the tasks called in that flow. The default task runner is the ConcurrentTaskRunner
. Tasks can be submitted to the task runner with the .submit
method to run them asynchronously and in parallel.
Here are some references from the Prefect documentation that provide more information:
- Dask and Ray Task Runners
- Successfully Deploying a Task Queue
- Concepts: Tasks
These guides highlight how to set up and use concurrent or parallel task execution within your Prefect workflows.