To Care or Not to Care : Analyzing the Caregiver in a Computational Gaze Following Framework