What you found is a well known trick to speed up the calculation of the SVD for substantially wide or tall matrices as described here. We also made use of this in this topic:
Maybe it is worth it to implement a fastsvd function into LinearAlgebra as well.