The IMMED project: wearable video monitoring of people with age dementia

In this paper, we describe a new application for multimedia indexing, using a system that monitors the instrumental activities of daily living to assess the cognitive decline caused by dementia. The system is composed of a wearable camera device designed to capture audio and video data of the instrumental activities of a patient, which is leveraged with multimedia indexing techniques in order to allow medical specialists to analyze several hour long observation shots efficiently.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[3]  Shahram Izadi,et al.  SenseCam: A Retrospective Memory Aid , 2006, UbiComp.

[4]  B. S. Manjunath,et al.  Introduction to mpeg-7 , 2002 .

[5]  David W. Murray,et al.  Designing a miniature wearable visual robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[6]  Bernard Mérialdo,et al.  Rushes Video Parsing Using Video Sequence Alignment , 2009, 2009 Seventh International Workshop on Content-Based Multimedia Indexing.

[7]  Steve Hodges,et al.  Neuropsychological Rehabilitation , 2013 .

[8]  J. Dartigues,et al.  [Methodological problems in clinical and epidemiological research on ageing]. , 2005, Revue d'epidemiologie et de sante publique.

[9]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Jenny Benois-Pineau,et al.  Camera Motion Detection in the Rough Indexing Paradigm , 2005, TRECVID.

[11]  Elie el Khoury,et al.  Improved speaker diarization system for meetings , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Dominique Barba,et al.  Recovering of visual scenarios in movies by motion analysis and grouping spatio-temporal colour signatures of video shots , 2001, EUSFLAT Conf..

[13]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[14]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[15]  Yannick Berthoumieu,et al.  Semi-supervised learning for location recognition from wearable video , 2010, 2010 International Workshop on Content Based Multimedia Indexing (CBMI).

[16]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[17]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[18]  Steve Hodges,et al.  The Use of a Wearable Camera, SenseCam, as a Pictorial Diary to Improve Autobiographical Memory in a Patient with Severe Memory Impairment , 2006 .

[19]  Aude Billard,et al.  WearCam: A head mounted wireless camera for monitoring gaze attention and for the diagnosis of developmental disorders in young children , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[20]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[21]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[23]  Zygmunt Pizlo,et al.  A study on the effect of camera motion on human visual attention , 2008, 2008 15th IEEE International Conference on Image Processing.

[24]  Patrick Gros,et al.  Hierarchical structure analysis of sport videos using HMMS , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[25]  Philippe Joly,et al.  Face-and-clothing based people clustering in video content , 2010, MIR '10.

[26]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, Electronic Imaging.

[27]  Jenny Benois-Pineau,et al.  Human Daily Activities Indexing in Videos from Wearable Cameras for Monitoring of Patients with Dementia Diseases , 2010, 2010 20th International Conference on Pattern Recognition.

[28]  Patrick Gros,et al.  Audiovisual integration with Segment Models for tennis video parsing , 2008, Comput. Vis. Image Underst..

[29]  Patricia Weiser Easteal,et al.  Australian Institute of Criminology 3 American Psychiatric Association Diagnosis and Statistical Manual of Mental Disorders , 1998 .

[30]  Jean-François Dartigues,et al.  Natural History of Decline in Instrumental Activities of Daily Living Performance over the 10 Years Preceding the Clinical Diagnosis of Dementia: A Prospective Population‐Based Study , 2008, Journal of the American Geriatrics Society.

[31]  Jenny Benois-Pineau,et al.  Wearable video monitoring of people with age Dementia : Video indexing at the service of helthcare , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.