Interrelation of the Environment of Lyα Emitters and Massive Galaxies at 2 < z < 4.5