Determining comprehension and quality of TV programs using eye-gaze tracking

Currently, TV programs are evaluated by using questionnaires given after previews or by using TV ratings. There are few objective criteria useful for describing technical know-how about program production. One of the TV program producers' concerns is how to choose expression methods that convey their ideas to viewers correctly and efficiently. Research has shown that eye-gaze direction is related to the human focus and attention. Gaze-based evaluations have been proposed for image-quality evaluations and certain usability tests. Such approaches are mainly based on how often a specific region attracted the subjects' gaze or how long their gaze was fixed on it. To apply these approaches to TV programs, all the object regions that seem to attract a viewer's gaze need to be specified in advance. This causes several problems including the accuracy of specifying the region by using an image processing technique is not equal to the human subject's recognition ability and it is not feasible to manually specify such regions in an enormous number of frames (images) comprising the program. Further, how characteristics of well-produced TV programs appear on the viewer's gaze has not been objectively analyzed yet. There is a need to investigate the relationship between gaze and program contents which can be used as means for improving comprehension and quality of the TV programs. In this paper, we propose a new measurement and evaluating method for this purpose. This paper focuses on the relationship between a viewer's comprehension of a program and their gaze direction in a real experimental TV educational program involving 26 elementary school children and broadcast by NHK Broadcasting Corporation of Japan. Correlation between TV program comprehension and entropy is investigated. That is, variances in the gaze direction in relation to program comprehension are based on a entropy value that represents the degree of dispersion in each frame and is calculated from a probability density function estimated from the gaze directions. The results indicate that the variances of the gaze direction for scenes that gave better comprehension tended to be lower. This tendency was further noticeable after a keyword utterance were related to the answers of corresponding questions.

[1]  C. R. Rao,et al.  Linear Statistical Inference and its Applications , 1968 .

[2]  Robert J. K. Jacob,et al.  Eye tracking in human-computer interaction and usability research : Ready to deliver the promises , 2002 .

[3]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[4]  Patricia Baggett,et al.  Role of temporal overlap of visual and auditory material in forming dual media associations. , 1984 .

[5]  Itoh Hideko,et al.  An Analysis of Eye Movements while Watching Educational TV Programs , 1991 .

[6]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[7]  J. Tipples.  Eye gaze is not unique: Automatic orienting in response to uninformative arrows , 2002, Psychonomic bulletin & review.

[8]  F. H. Adler,et al.  INFLUENCE OF FIXATION ON THE VISUAL ACUITY , 1934 .

[9]  Rajiv Khosla,et al.  Engineering Intelligent Hybrid Multi-Agent Systems , 1997, Springer US.

[10]  Alan Kingstone,et al.  Attentional effects of counterpredictive gaze and arrow cues. , 2004, Journal of experimental psychology. Human perception and performance.

[11]  D. Robinson.  A method of measuring eye movement using a scleral coil in a magnetic field , 1963 .

[12]  Guy J. Brown,et al.  A missing feature approach to instrument identification in polyphonic music , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[13]  Yu-Te Wu,et al.  A calibration-free gaze tracking technique , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[14]  Markku Tukiainen,et al.  An eye-tracking methodology for characterizing program comprehension processes , 2006, ETRA.

[15]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[16]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[17]  Fionn Murtagh,et al.  Computer display control and interaction using eye‐gaze , 2002 .

[18]  Rajiv Khosla,et al.  Intelligent Multimedia Multi-Agent Systems : a Human-Centered Approach , 2000 .

[19]  Takehiko Ohno,et al.  One-point calibration gaze tracking method , 2006, ETRA.

[20]  Bradley S. Gibson,et al.  Variation in cue duration reveals top-down modulation of involuntary orienting to uninformative symbolic cues , 2005, Perception & psychophysics.

[21]  Guillaume Gibert,et al.  Evaluation of a virtual speech cuer , 2006, ExLing.

[22]  Hua Wang,et al.  Empathic tutoring software agents using real-time eye tracking , 2006, ETRA '06.

[23]  A. Kingstone,et al.  Are eyes special? It depends on how you look at it , 2002, Psychonomic bulletin & review.

[24]  Hans-Bernd Brosius,et al.  Multiple effects of visual format on TV news learning , 1991 .

[25]  Fionn Murtagh,et al.  Interactive Visual User Interfaces: A Survey , 2003, Artificial Intelligence Review.

[26]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[27]  A. F. Smith,et al.  Statistical analysis of finite mixture distributions , 1986 .

[28]  Guillaume Gibert,et al.  Evaluating a virtual speech cuer , 2006, INTERSPEECH.

[29]  Heiner Deubel,et al.  The mind's eye : cognitive and applied aspects of eye movement research , 2003 .

[30]  Miki Namatame,et al.  Improving web usability for the hard-of-hearing , 2006, ETRA '06.

[31]  A. Kingstone,et al.  The eyes have it! Reflexive orienting is triggered by nonpredictive gaze , 1998 .

[32]  Chabane Djeraba,et al.  Eye/gaze tracking in web, image and video documents , 2006, MM '06.

[33]  Adrian E. Raftery,et al.  Model-Based Clustering, Discriminant Analysis, and Density Estimation , 2002 .

[34]  Georgene L. Troseth,et al.  Young children's use of video as a source of socially relevant information. , 2006, Child development.

[35]  S. Baron-Cohen,et al.  Gaze Perception Triggers Reflexive Visuospatial Orienting , 1999 .