Arnaud Legendre
11/14/2019, 1:29 PMChris White
Chris White
will the scheduler (supposedly based on dask.distributed) manage all the work and ressources properly ?Just to be clear, Prefect does not use Dask unless you explicitly configure it to. Prefect Core has a local, in-process, synchronous scheduler that is independent of Dask and Prefect Cloud has a persistent, fully asynchronous scheduler which is also independent of dask.
Arnaud Legendre
11/14/2019, 3:45 PMChris White
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by