How to browse through my large video data: face recognition & prioritizing for lifelog video

Due to the rise of lifelog cameras, we have personal video data that is too large to be watched. Video indexing has the potential to provide meta-information for faster video search. This work aims to support lifelog video indexing through automated face priority rating. In a user study, we identified parameters that allow for rating the importance of persons in a video. We implemented these findings to automatically predict the person's importance in video. We show that our algorithm predicts similar person priority ratings like the participants had given. Hence, we contribute to video-based lifelogging through indicating, implementing, and testing face indexing rules that predict how important a person in a video is perceived. Our findings can help to build video players that support users navigating through their large video data and reviewing sequences that recall important moments of life.

[1]  Ammad Ali,et al.  Face Recognition with Local Binary Patterns , 2012 .

[2]  W. Wagenaar.  My memory: A study of autobiographical memory over six years , 1986, Cognitive Psychology.

[3]  Ulric Neisser,et al.  Remembering Reconsidered: Ecological and Traditional Approaches to the Study of Memory , 1990 .

[4]  Tao Wang,et al.  Cast indexing for videos by NCuts and page ranking , 2007, CIVR '07.

[5]  L. Barsalou.  The content and organization of autobiographical memories , 1988 .

[6]  P. N. Bellhumer.  Eigenfaces vs. fisherfaces : Recognition using class specific linear projection , 1997 .

[7]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[8]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[9]  Alan F. Smeaton,et al.  Passively recognising human activities through lifelogging , 2011, Comput. Hum. Behav..

[10]  Albrecht Schmidt,et al.  Lifelogging: You're Wearing a Camera? , 2014, IEEE Pervasive Comput..

[11]  Sidney S. Fels,et al.  Visualization of personal history for video navigation , 2014, CHI.

[12]  Michael G. Christel.  Supporting video library exploratory search: when storyboards are not enough , 2008, CIVR '08.

[13]  He Ma,et al.  HUGVid: handling, indexing and querying of uncertain geo-tagged videos , 2012, SIGSPATIAL/GIS.

[14]  Christopher D. B. Burt,et al.  Retrieval characteristics of autobiographical memories: Event and date information , 1992 .

[15]  Alan F. Smeaton,et al.  Constructing a SenseCam visual diary as a media process , 2008, Multimedia Systems.

[16]  Matti Pietikäinen,et al.  Face Recognition with Local Binary Patterns , 2004, ECCV.

[17]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[18]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.