I’m not sure if this is the solution to your problem, but one thing I’ve found helps is running make cleanall before make. Especially when jumping over large numbers of commits, this helps a lot.
Also, you can bisect with HEAD~400 for arbitrary values of 400 to make sure you are looking at a linear set of commits.