https://prefect.io logo
Title
a

Attila

11/27/2019, 1:51 PM
Hi Everyone, I have a seemingly simple question but unfortunately I couldn't find an obvious answer (or I just couldn't see the forest for the trees): when I pass an unmapped object to a mapped task in a prefect flow, will the parallel executed tasks receive a copy of the object or will will the parallel tasks receive a reference to the same object? I would assume the former but just want to be sure.
c

Chris White

11/27/2019, 4:32 PM
Hi @Attila - this largely depends on the executor you use and how it implements parallelism; if you use the multi-threaded local dask executor, it might pass around a reference to the same object but in general parallelism is accomplished via multiple computers and / or multiprocessing, in which case copies are always created
a

Attila

11/28/2019, 7:20 AM
Hi @Chris White, thanks a lot for the clarification!