Brad I
09/02/2021, 4:30 PMflow.executor = DaskExecutor(
cluster_class=lambda: KubeCluster(
name=f"dask-{flow_image_name}",
pod_template=make_pod_spec(
image=prefect.context.image,
cpu_request=worker_cpu,
memory_request=worker_mem,
threads_per_worker=threads_per_worker
)
),
adapt_kwargs={
"minimum": min_workers,
"maximum": max_workers
},
)
Kevin Kho
Brad I
09/02/2021, 4:52 PMKevin Kho
Brad I
09/02/2021, 6:13 PMLocalDaskExecutor
to the DaskExecutor
.Kevin Kho
Brad I
09/02/2021, 6:54 PM