In my (small) experience, it depends on the backend. If you’re using the default for Plots.jl (GR.jl), LaTeX doesn’t work very well. It only works if you’re using a string that is all LaTeX, e.g.:
title!("\$\\alpha\$")
Otherwise you should currently use a different backend. For me, PyPlot.jl usually does its job with LaTeX.