Are you setting some env variable like LD_LIBRARY_PATH that could mess up library loading?
LD_LIBRARY_PATH
Try running LD_LIBRARY_PATH="" julia and see what happens:
LD_LIBRARY_PATH="" julia
Here are some related issues: