Human implicit intent transition detection based on pupillary analysis

Interpretation of human implicit intention is crucial in the development of an efficient nonverbal human computer interaction system. According to cognitive visuo-motor theory, the human eye movements and pupillary responses are rich source of information about the human intention and behavior. It has been observed that under conditions of constant illumination and accommodation, pupil size varies systematically in relation to a variety of physiological and psychological factors, such as level of mental effort. It is well known that pupillary responses could be used to measure the differences in cognitive load under various tasks. In this paper, we try to detect the transition between the different human implicit intents based on the pupil state analysis. In real-world environment, the pupillary response can be influenced by various external factors like intensity and size of the image. To overcome the influence of the external factors, we develop a robust baseline model. The proposed approach detects the transition of the human's implicit intent from navigational intent to informational intent and vice versa during a visual stimulus. The approach also detects the transition among the different states of the informational intent such as informational intent generation, informational intent maintenance and informational intent disappear.

[1]  Amanda Spink,et al.  Determining the informational, navigational, and transactional intent of Web queries , 2008, Inf. Process. Manag..

[2]  Daniel M. Russell,et al.  Discriminating the relevance of web search results with measures of pupil size , 2009, CHI.

[3]  W. Levelt,et al.  Pupillary dilation as a measure of attention: a quantitative system analysis , 1993 .

[4]  Sandra P. Marshall,et al.  Integrating psychophysiological measures of cognitive workload and eye movements to detect strategy shifts , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[5]  S. Sutton,et al.  Pupillary Response at Visual Threshold , 1966, Nature.

[6]  E. Hess,et al.  Pupillometry: The Psychology of the Pupillary Response , 1978 .

[7]  Peter Carruthers,et al.  The illusion of conscious will , 2007, Synthese.

[8]  Brian P. Bailey,et al.  Categories & Subject Descriptors: H.5.2 [Information , 2022 .

[9]  Claudio M. Privitera,et al.  The pupil dilation response to visual detection , 2008, Electronic Imaging.

[10]  Thomas Spyrou,et al.  Intention modelling: approximating computer user intentions for detection and prediction of intrusions , 1996, SEC.

[11]  Othman Omran Khalifa,et al.  EMG signal classification for human computer interaction: a review , 2009 .

[12]  Daniel E. Rose,et al.  Understanding user goals in web search , 2004, WWW '04.

[13]  Kwang-Eun Ko,et al.  A study on hybrid model of HMMs and GMMs for mirror neuron system modeling using EEG signals , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[14]  Alexander C. Schütz,et al.  Eye movements and perception: a selective review. , 2011, Journal of vision.

[15]  B. Goldwater Psychological significance of pupillary movements. , 1972, Psychological bulletin.

[16]  Ricardo Carelli,et al.  Human-machine interfaces based on EMG and EEG applied to robotic systems , 2008, Journal of NeuroEngineering and Rehabilitation.

[17]  E. Granholm,et al.  Pupillary responses index cognitive resource limitations. , 1996, Psychophysiology.

[18]  M. Tomasello,et al.  Does the chimpanzee have a theory of mind? 30 years later , 2008, Trends in Cognitive Sciences.

[19]  R M Burde,et al.  THE PUPIL , 1967, International ophthalmology clinics.

[20]  U. Schwarz,et al.  Cognitive eyes , 2004 .

[21]  Wei-Ying Ma,et al.  User Intention Modeling in Web Applications Using Data Mining , 2002, World Wide Web.

[22]  J. Beatty Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982, Psychological bulletin.

[23]  F A YOUNG,et al.  Pupillary contraction and dilation in light and darkness. , 1954, Journal of comparative and physiological psychology.