Remote REPL possible?

The open source version available in Linux package managers doesn’t.

The binary version by Microsoft does.

it does. some linux distros are listed here Visual Studio Code Remote Development Troubleshooting Tips and Tricks

it would be surprising that it wont work on linux given that ssh is OS-agnostic.