I think this problem might be specific to Plots’ gr backend. See this other post and this issue.
gr
It doesn’t happen for instance with plotlyjs or pythonplot backends.
plotlyjs
pythonplot
NB: the gaston backend seems to have the same limitation.
gaston