Question on Warning: `getindex(o::PyObject, s::AbstractString)` is deprecated in favor of dot overloading

Yes, I think that is what is intended here. The Matplotlib rcparams keys are strings with their own dot-structured hierarchy, and rcParams["text.usetex"] is indeed a correct key.