Arnaud Legendre11/14/2019, 1:29 PM
Chris White11/14/2019, 3:11 PM
will the scheduler (supposedly based on dask.distributed) manage all the work and ressources properly ?Just to be clear, Prefect does not use Dask unless you explicitly configure it to. Prefect Core has a local, in-process, synchronous scheduler that is independent of Dask and Prefect Cloud has a persistent, fully asynchronous scheduler which is also independent of dask.
Arnaud Legendre11/14/2019, 3:45 PM
Chris White11/14/2019, 3:46 PM