I ran into a similar issue when writing https://github.com/rdeits/NNLS.jl and ended up adapting some code by @tkoolen so that I could create unsafe but allocation-free views for use inside inner loops like this. I posted about it over ate Marching cubes without extra allocations - #2 by rdeits