Different inverse for almost equal matrices

Right, but when you multiply inv(A) by another matrix, you will accumulate more error, while B\A will have only one set of rounding.