I use Serialization.serialize() function to write julia objects on disk since I found it more efficient than other formats (like JLD2) and it’s for short term shortage so I can use the the same Julia runtime to read it back. It works well except that SharedArray cannot be serialized properly. It s…

Can you reinterpret a SharedArray and then serialize that?

I guess it makes sense to only pass pointers rather than real data when sending a SharedArray from one process to another (which is the real reason for serialization in the first place) but it doesn’t work in my case. Reinterpreting seems to allocate: julia> typeof(A) SharedArray{Float64,2} julia>…

[image] tk3369: Reinterpreting seems to allocate: See Big overhead with the new lazy reshape/reinterpret - #32 by pablosanjose

Unable to serialize SharedArrays

General Usage

ChrisRackauckas August 18, 2018, 5:58am 4

See Big overhead with the new lazy reshape/reinterpret - #32 by pablosanjose

Topic		Replies	Views
Memory Usage and SharedArrays Julia at Scale parallel , memory-allocation , distributed	8	1479	December 6, 2019
`similar` does not produce a SharedArray when fed one Internals & Design parallel	1	561	April 19, 2019
Why does `similar(::SharedArray)` create an `Array`? General Usage question	2	795	October 25, 2017
Improving serialization time Performance	7	673	June 2, 2018
Saving SharedArrays General Usage distributed	2	772	December 28, 2021

Unable to serialize SharedArrays

Related topics