I worked on this some more and eventually found that removing the line
ConnectTimeout 60
from my ~/.ssh/config solved the problem. Apparently the different versions of ssh interpret this differently. I now have RemoteREPL working as it should and fast login with the built in Windows version of ssh.