SenseCam: A Retrospective Memory Aid

This paper presents a novel ubiquitous computing device, the SenseCam, a sensor augmented wearable stills camera. SenseCam is designed to capture a digital record of the wearer's day, by recording a series of images and capturing a log of sensor data. We believe that reviewing this information will help the wearer recollect aspects of earlier experiences that have subsequently been forgotten, and thereby form a powerful retrospective memory aid. In this paper we review existing work on memory aids and conclude that there is scope for an improved device. We then report on the design of SenseCam in some detail for the first time. We explain the details of a first in-depth user study of this device, a 12-month clinical trial with a patient suffering from amnesia. The results of this initial evaluation are extremely promising; periodic review of images of events recorded by SenseCam results in significant recall of those events by the patient, which was previously impossible. We end the paper with a discussion of future work, including the application of SenseCam to a wider audience, such as those with neurodegenerative conditions such as Alzheimer's disease.

[1]  Michael D. Kopelman,et al.  Reducing the impact of cognitive impairment in dementia. , 2004 .

[2]  Gordon Bell,et al.  Passive capture and ensuing issues for a personal lifetime store , 2004, CARPE'04.

[3]  H. Emslie,et al.  Evaluation of NeuroPage: a new memory aid , 1997, Journal of neurology, neurosurgery, and psychiatry.

[4]  B. Julesz Textons, the elements of texture perception, and their interactions , 1981, Nature.

[5]  M. Bourgeois Enhancing conversation skills in patients with Alzheimer's disease using a prosthetic memory aid. , 1990, Journal of applied behavior analysis.

[6]  Jennifer Healey,et al.  StartleCam: a cybernetic wearable camera , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[7]  D. G. Lamb,et al.  Use of a comprehensive programme of external cueing to enhance procedural memory in a patient with dense amnesia. , 1996, Brain injury.

[8]  Steve Mann,et al.  'WearCam' (The wearable camera): personal imaging systems for long-term use in wearable tetherless computer-mediated reality and personal photo/videographic memory prosthesis , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[9]  Martin A. Conway,et al.  Memory and the self , 2005 .

[10]  Michael D. Kopelman,et al.  The handbook of memory disorders , 1995 .

[11]  J. Evans,et al.  Reducing everyday memory and planning problems by means of a paging system: a randomised control crossover study , 2001, Journal of neurology, neurosurgery, and psychiatry.

[12]  Robert A. Bjork,et al.  Optimum rehearsal patterns and name learning , 1978 .

[13]  Jyrki Hoisko Context triggered visual episodic memory prosthesis , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[14]  M. Lamming,et al.  The Design of a Human Memory Prosthesis , 1994 .

[15]  S. Cherry,et al.  Total recall [life recording software] , 2005, IEEE Spectrum.

[16]  P. E. Morris,et al.  Practical aspects of memory : current research and issues , 1988 .

[17]  Barbara A. Wilson,et al.  External memory aids and computers in memory rehabilitation , 2002 .

[18]  P. E. Morris,et al.  Practical aspects of memory , 1980 .

[19]  William F. Brewer,et al.  What is autobiographical memory , 1986 .

[20]  David C. Rubin,et al.  The Neuropsychology of Autobiographical Memory , 2003, Cortex.