As far as I understand, an important pragmatic disadvantage of BB binaries compared to build from source on the target machines is that they are generic. That is, nothing like -march=native or -ffast-math is possible within BB for performance-sensitive packages.