There have been various reports with similar problems. One possible solution: try to switch over to the new Pkg server infrastructure as recommended here:
There also have been various reports that virus checkers slow down registry updates. Excluding .julia/registries from the monitored directories appears to help sometimes. (I did not in my case [MacOS], but things got a lot faster in v1.6 for me).