Automatically Detecting "Significant Events" on SenseCam™

SenseCam is an effective memory-aid device that can automatically record images and other data from the wearer’s whole day. The main issue is that, while SenseCam produces a sizeable collection of images over the time period, the vast quantity of captured data contains a large percentage of routine events, which are of little interest to review. In this article, the aim is to detect “Significant Events” for the wearers.We use several time series analysis methods such as Detrended Fluctuation Analysis (DFA), Eigenvalue dynamics and Wavelet Correlations to analyse the multiple time series generated by the SenseCam. We show that Detrended Fluctuation Analysis exposes a strong long-range correlation relationship in SenseCam collections. Maximum Overlap Discrete Wavelet Transform (MODWT) was used to calculate equal-time Correlation Matrices over different time scales and then explore the granularity of the largest eigenvalue and changes of the ratio of the sub dominant eigenvalue spectrum dynamics over sliding time windows. By examination of the eigenspectrum, we show that these approaches enable detection of major events in the time SenseCam recording, with MODWT also providing useful insight on details of major events. We suggest that some wavelet scales (e.g. 8 minutes-16 minutes) have the potential to identify distinct events or activities.

[1]  H. Stanley,et al.  Detrended cross-correlation analysis: a new method for analyzing two nonstationary time series. , 2007, Physical review letters.

[2]  Todd R. Ogden,et al.  Wavelet Methods for Time Series Analysis , 2002 .

[3]  J. Bouchaud,et al.  Theory Of Financial Risk And Derivative Pricing , 2000 .

[4]  M. Crane,et al.  Random matrix theory for portfolio optimization: a stability approach , 2004 .

[5]  Kaspar Anton Schindler,et al.  Assessing seizure dynamics by analysing the correlation structure of multichannel intracranial EEG. , 2006, Brain : a journal of neurology.

[6]  T. Conlon,et al.  Wavelet Multiscale Analysis for Hedge Funds: Scaling and Strategies , 2008 .

[7]  G. Bell,et al.  A digital life , 2007 .

[8]  Kent Lyons,et al.  Capturing experiences anytime, anywhere , 2006, IEEE Pervasive Computing.

[9]  D. Wilcox,et al.  On the analysis of cross-correlations in South African market data , 2004 .

[10]  V. Plerou,et al.  Universal and Nonuniversal Properties of Cross Correlations in Financial Time Series , 1999, cond-mat/9902283.

[11]  J. Bouchaud,et al.  Noise Dressing of Financial Correlation Matrices , 1998, cond-mat/9810255.

[12]  Dave W. Randall,et al.  The past is a different place: they do things differently there , 2008, DIS '08.

[13]  Frank Hopfgartner,et al.  TV News Story Segmentation Based on Semantic Coherence and Content Similarity , 2010, MMM.

[14]  G. McDarby,et al.  Establishing the relation between detrended fluctuation analysis and power spectral density analysis for stochastic processes , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[15]  Shahram Izadi,et al.  SenseCam: A Retrospective Memory Aid , 2006, UbiComp.

[16]  Heather J. Ruskin,et al.  An econophysics approach to the Portuguese Stock Index—PSI-20 , 2004 .

[17]  A. Ioannides,et al.  Temporal correlations versus noise in the correlation matrix formalism: an example of the brain auditory response. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[18]  Anind K. Dey,et al.  Providing good memory cues for people with episodic memory impairment , 2007, Assets '07.

[19]  R. Mantegna,et al.  Long-range correlation properties of coding and noncoding DNA sequences: GenBank analysis. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[20]  Heather J. Ruskin,et al.  The reaction of stock markets to crashes and events: A comparison study between emerging and mature markets using wavelet transforms , 2006 .

[21]  V. Plerou,et al.  Identifying Business Sectors from Stock Price Fluctuations , 2000, cond-mat/0011145.

[22]  T. Conlon,et al.  Random Matrix Theory and Fund of Funds Portfolio Optimisation , 2007, 1005.5021.

[23]  C. Burrus,et al.  Introduction to Wavelets and Wavelet Transforms: A Primer , 1997 .

[24]  Alan F. Smeaton,et al.  Automatically Segmenting LifeLog Data into Events , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[25]  Wei-Hao Lin,et al.  Structuring continuous video recordings of everyday life using time-constrained clustering , 2006, Electronic Imaging.

[26]  C. Peng,et al.  Mosaic organization of DNA nucleotides. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.