Just want to mention that this issue has improved substantially for me since my last reply (still a slight lag, but half a second at most).
Only just noticed it now, but perhaps coincided with the release of 1.10.4. So if this was intentional, bravo to whoever was responsible!