Rigidity of spherical buildings and joins