Implicit image annotation by using gaze analysis

................................................................................................................................................ I ACKNOWLEDGEMENT .............................................................................................................................. II TABLE OF CONTENTS ............................................................................................................................... III LIST OF FIGURES ...................................................................................................................................... VI LIST OF TABLES ...................................................................................................................................... VIII NOMENCLATURE ...................................................................................................................................... X

[1]  B. Tatler,et al.  Yarbus, eye movements, and vision , 2010, i-Perception.

[2]  Sheng-Wen Shih,et al.  A novel approach to 3-D gaze tracking using stereo cameras , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[3]  Fred Stentiford,et al.  A performance comparison of eye tracking and mouse interfaces in a target image identification task , 2005 .

[4]  Jing Zhang,et al.  A Study of Top-Down Visual Attention Model Based on Similarity Distance , 2009, 2009 2nd International Congress on Image and Signal Processing.

[5]  P. Mikusinski,et al.  Introduction to Hilbert spaces with applications , 1990 .

[6]  S. Hochstein,et al.  Graded recognition as a function of the number of target fixations , 2010, Vision Research.

[7]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[8]  Zhiwei Zhu,et al.  Real-time eye detection and tracking under various light conditions , 2002, ETRA.

[9]  J. Rodgers,et al.  Thirteen ways to look at the correlation coefficient , 1988 .

[10]  Touradj Ebrahimi,et al.  Implicit emotional tagging of multimedia using EEG signals and brain computer interface , 2009, WSM@MM.

[11]  Gunhee Han,et al.  A 200 $\mu$ s Processing Time Smart Image Sensor for an Eye Tracker Using Pixel-Level Analog Image Processing , 2009, IEEE Journal of Solid-State Circuits.

[12]  Christos Diou,et al.  Image annotation using clickthrough data , 2009, CIVR '09.

[13]  Andreas Dengel,et al.  Attentive documents: Eye tracking as implicit feedback for information retrieval and beyond , 2012, TIIS.

[14]  M. Hemalatha,et al.  A combined hierarchical model for automatic image annotation and retrieval , 2011, 2011 Third International Conference on Advanced Computing.

[15]  Moshe Eizenman,et al.  A new methodology for determining point-of-gaze in head-mounted eye tracking systems , 2004, IEEE Transactions on Biomedical Engineering.

[16]  Franco Chiaraluce,et al.  Analysis of the Correlation Coefficient Between Component Noise Squared Norms for OFDM Systems , 2011, IEEE Signal Processing Letters.

[17]  Zeng Chen,et al.  Automatic image annotation based on decision tree machine learning , 2009, 2009 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery.

[18]  B. Tatler,et al.  The Moving Tablet Of The Eye , 2005 .

[19]  Maoguo Gong,et al.  Fuzzy C-Means Clustering With Local Information and Kernel Metric for Image Segmentation , 2013, IEEE Transactions on Image Processing.

[20]  Zhiwei Zhu,et al.  Novel Eye Gaze Tracking Techniques Under Natural Head Movement , 2007, IEEE Transactions on Biomedical Engineering.

[21]  Michael E. Tipping.  The Relevance Vector Machine , 1999, NIPS.

[22]  Lianfang Tian,et al.  Accelerating Relevance-Vector-Machine-Based Classification of Hyperspectral Image with Parallel Computing , 2012 .

[23]  Ebroul Izquierdo,et al.  Gaze movement inference for implicit image annotation , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[24]  A. Dorado,et al.  Semi-automatic image annotation using frequent keyword mining , 2003, Proceedings on Seventh International Conference on Information Visualization, 2003. IV 2003..

[25]  Vincent Lepetit,et al.  Keypoint recognition using randomized trees , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Harish Katti,et al.  Eye-tracking methodology and applications to images and video , 2011, MM '11.

[27]  Ebroul Izquierdo,et al.  Reading Users' Minds From Their Eyes: A Method for Implicit Image Annotation , 2012, IEEE Transactions on Multimedia.

[28]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[29]  Nicolas Tsapatsoulis,et al.  Automatic annotation of image databases based on implicit crowdsourcing, visual concept modeling and evolution , 2012, Multimedia Tools and Applications.

[30]  Kitsuchart Pasupa,et al.  Learning to rank images from eye movements , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[31]  Bin Luo,et al.  An automatic image annotation method based on the mutual K-nearest neighbor graph , 2010, 2010 Sixth International Conference on Natural Computation.

[32]  Alessandro Ferrero,et al.  Instrumental Uncertainty and Model Uncertainty Unified in a Modified Fuzzy Inference System , 2010, IEEE Transactions on Instrumentation and Measurement.

[33]  Edmond Chalom,et al.  Measuring image similarity: an overview of some useful applications , 2013, IEEE Instrumentation & Measurement Magazine.

[34]  Michael R. Lyu,et al.  Bridging the Semantic Gap Between Image Contents and Tags , 2010, IEEE Transactions on Multimedia.

[35]  Udo Hahn,et al.  A Cognitive Cost Model of Annotations Based on Eye-Tracking Data , 2010, ACL.

[36]  N. Chowdhury,et al.  A comparative analysis of Feed-forward neural network & Recurrent Neural network to detect intrusion , 2008, 2008 International Conference on Electrical and Computer Engineering.

[37]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[38]  Alireza Sahami Shirazi,et al.  Increasing the user's attention on the web: using implicit interaction based on gaze behavior to tailor content , 2012, NordiCHI.

[39]  Wei Ji Ma,et al.  Does precision decrease with set size? , 2012, Journal of vision.

[40]  Nicolas Tsapatsoulis,et al.  Implicit visual concept modeling in image / video annotation , 2010, ARTEMIS '10.

[41]  Rafael Cabeza,et al.  A Novel Gaze Estimation System With One Calibration Point , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[42]  Stephen R. Gulliver,et al.  Stars in their eyes: what eye-tracking reveals about multimedia perceptual quality , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[43]  Dongjian He,et al.  Ensemble of multiple descriptors for automatic image annotation , 2010, 2010 3rd International Congress on Image and Signal Processing.

[44]  John R. Wolberg,et al.  Data Analysis Using the Method of Least Squares: Extracting the Most Information from Experiments , 2005 .

[45]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[46]  K. Jellinger.  The Moving Tablet of the Eye: The Origins of Modern Eye Movement Research , 2006 .

[47]  Ioannis Patras,et al.  Fusion of facial expressions and EEG for implicit affective tagging , 2013, Image Vis. Comput..

[48]  Adilson Gonzaga,et al.  Dynamic Features for Iris Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[49]  José Hernández-Orallo,et al.  An experimental comparison of performance measures for classification , 2009, Pattern Recognit. Lett..

[50]  Yiannis Kompatsiaris,et al.  Exploiting gaze movements for automatic video annotation , 2012, 2012 13th International Workshop on Image Analysis for Multimedia Interactive Services.

[51]  Yun Zhang,et al.  Eye movement as an interaction mechanism for relevance feedback in a content-based image retrieval system , 2010, ETRA.

[52]  Eileen Kowler,et al.  Visual search for category sets: tradeoffs between exploration and memory. , 2011, Journal of vision.

[53]  Marti A. Hearst.  Trends & Controversies: Support Vector Machines , 1998, IEEE Intell. Syst..

[54]  M. Land.  Vision, eye movements, and natural behavior , 2009, Visual Neuroscience.

[55]  H. Sorenson.  Least-squares estimation: from Gauss to Kalman , 1970, IEEE Spectrum.

[56]  E. Izquierdo,et al.  Image annotation through gaming (TAG4FUN) , 2009, 2009 16th International Conference on Digital Signal Processing.

[57]  Eugene Paperno,et al.  Magnetic Eye Tracking: A New Approach Employing a Planar Transmitter , 2010, IEEE Transactions on Biomedical Engineering.

[58]  Mohammad Soleymani,et al.  Human-centered implicit tagging: Overview and perspectives , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[59]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[60]  Paul W. Goldberg,et al.  Bounding the Vapnik-Chervonenkis Dimension of Concept Classes Parameterized by Real Numbers , 1993, COLT '93.

[61]  Ebroul Izquierdo,et al.  Finding the user's interest level from their eyes , 2010, SAPMIA '10.

[62]  Ebroul Izquierdo,et al.  Examining visual attention: A method for revealing users' interest for images on screen , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[63]  Francisco Herrera,et al.  Cooperative Evolutionary Learning of Linguistic Fuzzy Rules and Parametric Aggregation Connectors for Mamdani Fuzzy Systems , 2007, IEEE Transactions on Fuzzy Systems.

[64]  Hani Hagras,et al.  Toward General Type-2 Fuzzy Logic Systems Based on zSlices , 2010, IEEE Transactions on Fuzzy Systems.

[65]  Andreas Dengel,et al.  Eye movements as implicit relevance feedback , 2008, CHI Extended Abstracts.

[66]  Yi Yang,et al.  Web and Personal Image Annotation by Mining Label Correlation With Relaxed Visual Graph Embedding , 2012, IEEE Transactions on Image Processing.

[67]  Naomi M. Kenner,et al.  How fast can you change your mind? The speed of top-down guidance in visual search , 2004, Vision Research.

[68]  J. Wolfe,et al.  Attention is fast but volition is slow , 2000, Nature.

[69]  Ebroul Izquierdo,et al.  Gaze movement inference for user adapted image annotation and retrieval , 2011, SBNMA '11.

[70]  Samuel Kaski,et al.  Can relevance of images be inferred from eye movements? , 2008, MIR '08.

[71]  Concetto Spampinato,et al.  Visual attention for implicit relevance feedback in a content based image retrieval , 2010, ETRA '10.

[72]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[73]  H. Wilcox.  Elementary Linear Algebra , 1970 .

[74]  J. Navarro-Pedreño.  Numerical Methods for Least Squares Problems , 1996 .

[75]  Md Jan Nordin,et al.  Review on statistical approaches for automatic image annotation , 2009, 2009 International Conference on Electrical Engineering and Informatics.

[76]  Yan Cui,et al.  MRI brain image segmentation for spotting tumors using improved mountain clustering approach , 2009, 2009 IEEE Applied Imagery Pattern Recognition Workshop (AIPR 2009).

[77]  Andrzej Sluzek,et al.  Automatic image annotation by image fragment matching , 2011, 2011 Federated Conference on Computer Science and Information Systems (FedCSIS).

[78]  Jerry M. Mendel,et al.  On the Stability of Interval Type-2 TSK Fuzzy Logic Control Systems , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[79]  Chong Wang,et al.  Simultaneous image classification and annotation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[80]  Brandon E Gavett,et al.  The role of salience in localized attentional interference , 2004, Vision Research.

[81]  S. Sivanandam,et al.  Introduction to Fuzzy Logic using MATLAB , 2006 .

[82]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[83]  Chew Lim Tan,et al.  A Semantic Similarity Language Model to Improve Automatic Image Annotation , 2010, 2010 22nd IEEE International Conference on Tools with Artificial Intelligence.

[84]  John Q. Gan,et al.  Extracting Takagi-Sugeno Fuzzy Rules with Interpretable Submodels via Regularization of Linguistic Modifiers , 2009, IEEE Transactions on Knowledge and Data Engineering.

[85]  Jarmo Verho,et al.  A Wearable, Wireless Gaze Tracker with Integrated Selection Command Source for Human‐Computer Interaction , 2011, IEEE Transactions on Information Technology in Biomedicine.

[86]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[87]  Guiguang Ding,et al.  Automatic semantic annotation of images based on Web data , 2010, 2010 Sixth International Conference on Information Assurance and Security.

[88]  Tilo Strutz,et al.  Data Fitting and Uncertainty: A practical introduction to weighted least squares and beyond , 2010 .

[89]  Tianwen Zhang,et al.  Using Example-Based Machine Translation Method For Automatic Image Annotation , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[90]  Iain D Gilchrist,et al.  Goal-driven modulation of oculomotor capture , 2003, Perception & psychophysics.

[91]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[92]  I. Burhan Türksen,et al.  Enhanced Fuzzy System Models With Improved Fuzzy Clustering Algorithm , 2008, IEEE Transactions on Fuzzy Systems.

[93]  Weldon A. Lodwick,et al.  Fuzzy Optimization - Recent Advances and Applications , 2010, Studies in Fuzziness and Soft Computing.

[94]  Subramanian Ramanathan,et al.  Can computers learn from humans to see better?: inferring scene semantics from viewers' eye movements , 2011, ACM Multimedia.

[95]  Maja Pantic,et al.  Implicit human-centered tagging [Social Sciences] , 2009, IEEE Signal Process. Mag..

[96]  W. Einhäuser,et al.  Animal detection and identification in natural scenes: image statistics and emotional valence. , 2012, Journal of vision.

[97]  M. Proulx.  Bottom-up guidance in visual search for conjunctions. , 2007, Journal of experimental psychology. Human perception and performance.

[98]  R. Rosenholtz,et al.  A summary statistic representation in peripheral vision explains visual search. , 2009, Journal of vision.

[99]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[100]  Nuno Correia,et al.  Playing games as a way to improve automatic image annotation , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[101]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[102]  Steffen Staab,et al.  Identifying Objects in Images from Analyzing the Users' Gaze Movements for Provided Tags , 2012, MMM.

[103]  Jorma Laaksonen,et al.  Pinview: Implicit Feedback in Content-Based Image Retrieval , 2010, WAPA.

[104]  Ke Chen,et al.  An algorithm of image retrieval based on content similarity , 2011, 2011 IEEE International Conference on Computer Science and Automation Engineering.

[105]  Michelle R. Greene,et al.  Reconsidering Yarbus: A failure to predict observers’ task from eye movement patterns , 2012, Vision Research.

[106]  Jun Jiao,et al.  Implicit image tagging via facial information , 2010, SSPW '10.

[107]  S. Celebrini,et al.  Privileged visual processing of the straight-ahead direction in humans. , 2012, Journal of vision.

[108]  Samuel Kaski,et al.  GaZIR: gaze-based zooming interface for image retrieval , 2009, ICMI-MLMI '09.

[109]  Ingrid Heynderickx,et al.  Visual Attention in Objective Image Quality Assessment: Based on Eye-Tracking Data , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[110]  Giancarlo Iannizzotto,et al.  Competitive Combination of Multiple Eye Detection and Tracking Techniques , 2011, IEEE Transactions on Industrial Electronics.

[111]  Dan Li,et al.  Fuzzy c-means clustering of partially missing data sets based on statistical representation , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[112]  R. Brereton,et al.  Support vector machines for classification and regression. , 2010, The Analyst.

[113]  Karl J. Friston,et al.  Top-down Modulations in the Visual Form Pathway Revealed with Dynamic Causal Modeling , 2010, Cerebral cortex.

[114]  Fatos T. Yarman Vural,et al.  HANOLISTIC: A Hierarchical automatic Image Annotation System Using Holistic Approach , 2008, ISCIS 2008.

[115]  Aditya Murthy,et al.  Mutual inhibition and capacity sharing during parallel preparation of serial eye movements. , 2012, Journal of vision.

[116]  Roel Vertegaal,et al.  ViewPointer: lightweight calibration-free eye tracking for ubiquitous handsfree deixis , 2005, UIST.

[117]  Mary Czerwinski,et al.  Semi-Automatic Image Annotation , 2001, INTERACT.

[118]  David Whitaker,et al.  Size-induced distortions in perceptual maps of visual space. , 2012, Journal of vision.

[119]  Margrit Betke,et al.  A Human–Computer Interface Using Symmetry Between Eyes to Detect Gaze Direction , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[120]  Ilaria Bartolini,et al.  Multi-dimensional keyword-based image annotation and search , 2010, KEYS '10.

[121]  Peter D. Lawrence,et al.  Noncontact Binocular Eye-Gaze Tracking for Point-of-Gaze Estimation in Three Dimensions , 2009, IEEE Transactions on Biomedical Engineering.

[122]  Benjamin B. Bederson,et al.  Semi-Automatic Image Annotation Using Event and Torso Identification , 2004 .

[123]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[124]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[125]  Kitsuchart Pasupa,et al.  Image ranking with implicit feedback from eye movements , 2010, ETRA.

[126]  F. Träisk,et al.  A comparison between the magnetic scleral search coil and infrared reflection methods for saccadic eye movement analysis , 2005, Graefe's Archive for Clinical and Experimental Ophthalmology.

[127]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[128]  Alan C. Bovik,et al.  GAFFE: A Gaze-Attentive Fixation Finding Engine , 2008, IEEE Transactions on Image Processing.

[129]  Gabriel-Miro Muntean,et al.  An eye-tracking-based adaptive multimedia streaming scheme , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[130]  John Shawe-Taylor,et al.  Can eyes reveal interest? Implicit queries from gaze patterns , 2009, User Modeling and User-Adapted Interaction.

[131]  Divna Djordjevic,et al.  User relevance feedback, search and retrieval of visual content , 2006 .