tkanas11/24/2020, 1:16 AM
Saulius Beinorius11/24/2020, 8:05 AM
I was wondering what people do when coming across parts of objects that are not serializable by CloudpickleUsually it's not that difficult to guess which objects are not serializable, these are the ones with external system access, various sessions, service clients, etc. The only real way to deal with this is to re-create them within each task, as there is no way to transfer, for example, a file pointer.
tkanas11/25/2020, 12:53 AM
only saves results of successful tasks.