Accuracy in detecting referents of pointing gestures unaccompanied by language

It has been claimed that the perceptual accuracy with which people compre hend distal pointing gestures is low. But this claim is at odds with research showing that detection of other indexical signals, e.g., eye gaze, is very ac curate. We conducted three experiments to assess people’s detection accuracy of targets of distal pointing gestures, using a paradigm adapted from the study of eye gaze. Pairs of people were seated next to each other. One person pointed at targets among 70 points arranged in a horizontal (Experiment 1) or vertical line (Experiment 2). The other person guessed the target. Bias in detection was substantially less than previously shown (approximately 3° in vertical and horizontal conditions), and comparable to levels of accuracy for eye gaze detection. Furthermore, and contrary to previous research, detection accuracy was lower for peripheral targets than for central ones. Experiment 3 replicated Experiments 1 and 2 within one study and further demonstrated that partial occlusion of the pointing arm (from shoulder to elbow) did not adversely affect accuracy.

[1]  J. Gibson,et al.  Perception of another person's looking behavior. , 1963, The American journal of psychology.

[2]  M. Cline The perception of where a person is looking. , 1967, The American journal of psychology.

[3]  E. Schegloff,et al.  The preference for self-correction in the organization of repair in conversation , 1977 .

[4]  D. McNeill So you think gestures are nonverbal , 1985 .

[5]  H. H. Clark,et al.  Referring as a collaborative process , 1986, Cognition.

[6]  Dagmar Schmauks Deixis in der Mensch-Maschine-Interaktion: multimediale Referentenidentifikation durch natürliche und simulierte Zeigegesten , 1991 .

[7]  R. Krauss,et al.  Do conversational hand gestures communicate? , 1991, Journal of personality and social psychology.

[8]  A. Kendon Do Gestures Communicate? A Review , 1994 .

[9]  M. Argyle,et al.  Gaze and Mutual Gaze , 1994, British Journal of Psychiatry.

[10]  Herbert H. Clark,et al.  Managing problems in speaking , 1994, Speech Communication.

[11]  Philip J. Barnard,et al.  Deixis and points of view in media spaces: An empirical gesture , 1996, Behav. Inf. Technol..

[12]  C. L. Schmidt,et al.  Adult Understanding of Spontaneous Attention-Directing Events: What Does Gesture Contribute? , 1999 .

[13]  V. Bruce,et al.  You must see the point: automatic processing of cues to the direction of social attention. , 2000, Journal of experimental psychology. Human perception and performance.

[14]  G. Butterworth,et al.  How the eyes, head and hand serve definite reference , 2000 .

[15]  A F Monk,et al.  Where am I looking? The accuracy of video-mediated gaze awareness , 2000, Perception & psychophysics.

[16]  J. Bavelas,et al.  Visible Acts of Meaning , 2000 .

[17]  G. Butterworth Pointing Is the Royal Road to Language for Babies , 2003 .

[18]  S. Kita Pointing: Where language, culture, and cognition meet , 2003 .

[19]  Susan R. Fussell,et al.  Gestures Over Video Streams to Support Remote Collaboration on Physical Tasks , 2004, Hum. Comput. Interact..

[20]  A. Bangerter,et al.  Using Pointing and Describing to Achieve Joint Focus of Attention in Dialogue , 2004, Psychological science.