For those keeping track: unsafe_load indeed ends up creating a copy of that mutable struct, which is very unfortunate 
The approach I outlined above doesn’t work.
For those keeping track: unsafe_load indeed ends up creating a copy of that mutable struct, which is very unfortunate The approach I outlined above doesn’t work.