QR (used by X \ y
) isn’t generally faster than the normal equations (it has the same complexity, but a worse constant factor). But it’s more accurate in general, sometimes much more accurate (if X
is badly conditioned). See Efficient way of doing linear regression - #33 by stevengj
11 Likes