It is a known issue: [bug] invisible underscore in integrated-terminal · Issue #38133 · microsoft/vscode · GitHub
The problem is a combination of zoom level and font size. Changing the font size of the terminal to 13 (it was 14) solved the issue here.