Are you using Windows in a corporate environment by any chance?
I suffered a similar issue (but much worse latency) and concluded it was because of corporate IT security policies. Extended discussion here.
2 Likes