Maybe the eigenvalues at the edges of the window are badly converged? (I have no experience with ArnoldiMethod.jl but KrylovKit.jl does ensure convergence of the requested number of eigenvectors IIRC).
A quick check is to just request some more vectors and compare the resulting matrices.
Out of curiosity: How large are your matrices?