Log scale axis issue with PyPlot (and how to manually fix it)

When I execute the following code using PyPlot (Julia 1.5.0 on Windows):

using Plots
pyplot()
scatter(1:5, [1, 1e-5,1e-10,1e-15,1e-20], yaxis=:log)

The y axis doesn’t show properly. But I have realized by clicking on ‘Figure options’ in the menu that the y scale is actually set to linear. If I set it to log, then everything is fine. The same thing seems to happen with the x scale.