Alex Cano
07/17/2019, 10:11 PMJeremiah
07/18/2019, 1:36 AMAlex Cano
07/18/2019, 4:46 AMJeremiah
07/18/2019, 2:27 PMLocalExecutor
, you’re bounded by available RAM. If you’re using a Dask cluster, you’ll be bounded by the amount of data you need to serialize over the wire at once. 1TB will almost certainly need to go in cloud storage 🙂 but 1GB should be totally fine in either case on a reasonably provisioned machine. If you want to ping us (cc @Chris White) privately with a specific concern, we’ll be happy to guide youChris White
07/18/2019, 2:57 PMAlex Cano
07/18/2019, 3:06 PMChris White
07/18/2019, 3:08 PMAlex Cano
07/18/2019, 3:13 PMChris White
07/18/2019, 3:17 PMJeremiah
07/18/2019, 3:18 PMAlex Cano
07/18/2019, 3:28 PMJeremiah
07/18/2019, 3:29 PM