Thanks. Those are definitely a better way of handling it.
Is the DArray
constructor able to handle the same stuff as pmap
? For example, does it need to use a CachingPool
for large anonymous functions? Is it essentially a batch_size = N/nprocs()
kind of pmap
?