Annotate! on pyplot backend not working properly

Something is not right with annotate and the pyplot backend.
If I use gr() this shows properly my output

on the other hand pyplot it’s not.

I would use gr() but the file size output is to big, that’s why I need pyplot. Any ideas?