Plotting into buffer

yeah that will be a problem.
If it uses OpenGL as well, there should be other ways though.
You could look at the clmgui Makie integration: