Multiscaled Cross-Correlation Dynamics on SenseCam Lifelogged Images

In this paper, we introduce and evaluate a novel approach, namely the use of the cross correlation matrix and Maximum Overlap Discrete Wavelet Transform (MODWT) to analyse SenseCam lifelog data streams. SenseCam is a device that can automatically record images and other data from the wearer’s whole day. It is a significant challenge to deconstruct a sizeable collection of images into meaningful events for users. The cross-correlation matrix was used, to characterise dynamical changes in non-stationary multivariate SenseCam images. MODWT was then applied to equal-time Correlation Matrices over different time scales and used to explore the granularity of the largest Eigenvalue and changes, in the ratio of the sub-dominant Eigenvalue spectrum dynamics, over sliding time windows. By examination of the eigenspectrum, we show that these approaches can identify “Distinct Significant Events” for the wearers. The dynamics of the Eigenvalue spectrum across multiple scales provide useful insight on details of major events in SenseCam logged images.

[1]  V. Plerou,et al.  Universal and Nonuniversal Properties of Cross Correlations in Financial Time Series , 1999, cond-mat/9902283.

[2]  J. Bouchaud,et al.  Theory Of Financial Risk And Derivative Pricing , 2000 .

[3]  R. Mantegna,et al.  Long-range correlation properties of coding and noncoding DNA sequences: GenBank analysis. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[4]  Kent Lyons,et al.  Capturing experiences anytime, anywhere , 2006, IEEE Pervasive Computing.

[5]  T. Conlon,et al.  Wavelet Multiscale Analysis for Hedge Funds: Scaling and Strategies , 2008 .

[6]  D. Wilcox,et al.  On the analysis of cross-correlations in South African market data , 2004 .

[7]  J. Bouchaud,et al.  RANDOM MATRIX THEORY AND FINANCIAL CORRELATIONS , 2000 .

[8]  Heather J. Ruskin,et al.  The reaction of stock markets to crashes and events: A comparison study between emerging and mature markets using wavelet transforms , 2006 .

[9]  C. Peng,et al.  Mosaic organization of DNA nucleotides. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[10]  H. Stanley,et al.  Detrended cross-correlation analysis: a new method for analyzing two nonstationary time series. , 2007, Physical review letters.

[11]  Anind K. Dey,et al.  Providing good memory cues for people with episodic memory impairment , 2007, Assets '07.

[12]  A. Ioannides,et al.  Temporal correlations versus noise in the correlation matrix formalism: an example of the brain auditory response. , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[13]  Frank Hopfgartner,et al.  TV News Story Segmentation Based on Semantic Coherence and Content Similarity , 2010, MMM.

[14]  Heather J. Ruskin,et al.  An econophysics approach to the Portuguese Stock Index—PSI-20 , 2004 .

[15]  Paul Dourish,et al.  UbiComp 2006: Ubiquitous Computing, 8th International Conference, UbiComp 2006, Orange County, CA, USA, September 17-21, 2006 , 2006, UbiComp.

[16]  T. Conlon,et al.  Random Matrix Theory and Fund of Funds Portfolio Optimisation , 2007, 1005.5021.

[17]  Alan F. Smeaton,et al.  Automatically Segmenting LifeLog Data into Events , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[18]  G. McDarby,et al.  Establishing the relation between detrended fluctuation analysis and power spectral density analysis for stochastic processes , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[19]  Wei-Hao Lin,et al.  Structuring continuous video recordings of everyday life using time-constrained clustering , 2006, Electronic Imaging.

[20]  Kaspar Anton Schindler,et al.  Increasing synchronization may promote seizure termination: Evidence from status epilepticus , 2007, Clinical Neurophysiology.

[21]  Shahram Izadi,et al.  SenseCam: A Retrospective Memory Aid , 2006, UbiComp.

[22]  V. Plerou,et al.  Identifying Business Sectors from Stock Price Fluctuations , 2000, cond-mat/0011145.

[23]  J. Bouchaud,et al.  Noise Dressing of Financial Correlation Matrices , 1998, cond-mat/9810255.

[24]  Dave W. Randall,et al.  The past is a different place: they do things differently there , 2008, DIS '08.

[25]  田中 勝人.  D. B. Percival and A. T. Walden: Wavelet Methods for Time Series Analysis, Camb. Ser. Stat. Probab. Math., 4, Cambridge Univ. Press, 2000年，xxvi + 594ページ． , 2009 .

[26]  M. Crane,et al.  Random matrix theory for portfolio optimization: a stability approach , 2004 .

[27]  A Chaudhuri,et al.  First Penning trap mass measurements beyond the proton drip line. , 2008, Physical review letters.

[28]  A. Walden,et al.  Wavelet Methods for Time Series Analysis , 2000 .

[29]  Heather J. Ruskin,et al.  Automatically Detecting "Significant Events" on SenseCam™ , 2013, ERCIM News.

[30]  D. Randall,et al.  Thanks for the memory , 2007, BCS HCI.

[31]  Matthieu Guillaumin,et al.  Combining Image-Level and Segment-Level Models for Automatic Annotation , 2012, MMM.

[32]  G. Bell,et al.  A digital life , 2007 .

[33]  M. Oshikawa,et al.  Random matrix theory analysis of cross correlations in financial markets. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Kaspar Anton Schindler,et al.  Assessing seizure dynamics by analysing the correlation structure of multichannel intracranial EEG. , 2006, Brain : a journal of neurology.

[35]  C. Burrus,et al.  Introduction to Wavelets and Wavelet Transforms: A Primer , 1997 .

[36]  V. Plerou,et al.  Random matrix approach to cross correlations in financial data. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.