Luis Gallegos
02/11/2021, 5:34 PMJim Crist-Harif
02/11/2021, 5:53 PMLuis Gallegos
02/11/2021, 6:47 PM# Use a virtual environment at /path/to/my/virtual/env
cluster = YarnCluster(environment='venv:///path/to/my/virtual/env')
Jim Crist-Harif
02/11/2021, 7:04 PMDaskExecutor
is just a thin wrapper around all the different dask cluster-manager classes, so any way you're used to creating a dask cluster can work with prefect.Luis Gallegos
02/11/2021, 7:32 PM