I think you could probably do this with an in-place factorization, for example F = lu!(A_HD) with an Mmap’d array A. I’m not sure this is completely allocation-free but it’s a place to start looking.
See also
By the way it’s unlikely to be helpful to mmap your vector b_HD because it’s so much smaller than the matrix.