Constructing a permutation matrix

[stevengj]

@Dan

Also, this seems like a good problem to be lazy about,

Hard to say without more context. Storing the permuted matrix lazily will make many operations on it much slower.