Discriminant Analysis of Human`s Implicit Intent based on Eyeball Movement

Recently, there has been tremendous increase in human-computer/machine interaction system, where the goal is to provide with an appropriate service to the user at the right time with minimal human inputs for human augmented cognition system. To develop an efficient human augmented cognition system based on human computer/machine interaction, it is important to interpret the user`s implicit intention, which is vague, in addition to the explicit intention. According to cognitive visual-motor theory, human eye movements and pupillary responses are rich sources of information about human intention and behavior. In this paper, we propose a novel approach for the identification of human implicit visual search intention based on eye movement pattern and pupillary analysis such as pupil size, gradient of pupil size variation, fixation length/count for the area of interest. The proposed model identifies the human`s implicit intention into three types such as navigational intent generation, informational intent generation, and informational intent disappearance. Navigational intent refers to the search to find something interesting in an input scene with no specific instructions, while informational intent refers to the search to find a particular target object at a specific location in the input scene. In the present study, based on the human eye movement pattern and pupillary analysis, we used a hierarchical support vector machine which can detect the transitions between the different implicit intents - navigational intent generation to informational intent generation and informational intent disappearance.

[1]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.

[2]  Cynthia Breazeal,et al.  Social interactions in HRI: the robot view , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Amanda Spink,et al.  Determining the informational, navigational, and transactional intent of Web queries , 2008, Inf. Process. Manag..

[4]  Daniel E. Rose,et al.  Understanding user goals in web search , 2004, WWW '04.

[5]  Joon-Hyuk Chang,et al.  Fine-tuning SVM for Enhancing Speech/Music Classification , 2011 .

[6]  홍철의,et al.  효율적 검색의도 파악을 위한 쿼리 단어 가시화에 관한 연구 , 2012 .

[7]  Paul M Bays,et al.  Temporal dynamics of encoding, storage, and reallocation of visual working memory. , 2011, Journal of vision.

[8]  Julie M. Harris,et al.  Characterising patterns of eye movements in natural images and visual scanning , 2008 .

[9]  Alexander C. Schütz,et al.  Eye movements and perception: a selective review. , 2011, Journal of vision.

[10]  Minho Lee,et al.  Recognition of Human's Implicit Intention Based on an Eyeball Movement Pattern Analysis , 2011, ICONIP.

[11]  Wei-Ying Ma,et al.  User Intention Modeling in Web Applications Using Data Mining , 2002, World Wide Web.

[12]  B. C. Lacey,et al.  Pupillary and cardiac activity during visual attention. , 1973, Psychophysiology.

[13]  심정연 개인성을 고려한 지식-감정 반응 모델의 설계 , 2010 .

[14]  Wonil Kim,et al.  Revealing Hidden Relations between Query-Words for an Efficient Inducing User's Intention of an Information Search , 2012 .

[15]  Claudio M. Privitera,et al.  The pupil dilation response to visual detection , 2008, Electronic Imaging.

[16]  JeongYon Shim The Design of Knowledge-Emotional Reaction Model considering Personality , 2010 .

[17]  Brian P. Bailey,et al.  Categories & Subject Descriptors: H.5.2 [Information , 2022 .

[18]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[19]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[20]  임정수,et al.  SVM의 미세조정을 통한 음성/음악 분류 성능향상 , 2011 .

[21]  W. S. Peavler,et al.  Incentive effects and pupillary changes in association learning. , 1969, Journal of experimental psychology.

[22]  변증남,et al.  바이오사인에 기반한 HCI 및 서비스 로봇에의 응용 , 2001 .

[23]  Päivi Majaranta,et al.  Twenty years of eye typing: systems and design issues , 2002, ETRA.

[24]  Minho Lee,et al.  Human implicit intent transition detection based on pupillary analysis , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).