THE SXDF-ALMA 2 arcmin2 DEEP SURVEY: STACKING REST-FRAME NEAR-INFRARED SELECTED OBJECTS