Computer modern font in every element of plot (PyPlot)

Setting this line to true:

PyPlot.matplotlib[:rc]("text", usetex=true)

Seems to fix the issue on external plot window:
PyPlot_CM_ComputerModern_font

Not sure what you mean by inline plot but linking this thread, which is rich in related info.