Finding Motifs in Larger Personal Lifelogs

The term Visual Lifelogging is used to describe the process of tracking personal activities by using wearable cameras. A typical example of wearable cameras is Microsoft’s SenseCam that can capture vast personal archives per day. A significant challenge is to organise and analyse such large volumes of lifelogging data. State-ofthe-art techniques use supervised machine learning techniques to search and retrieve useful information, which requires prior knowledge about the data. We argue that these so-called rule-based and concept-based techniques may not offer the best solution for analysing large and unstructured collections of visual lifelogs. Treating lifelogs as time series data, we study in this paper how motifs techniques can be used to identify repeating events. We apply the Minimum Description Length (MDL) method to extract multi-dimensional motifs in time series data. Our initial results suggest that motifs analysis provides a useful probe for identification and interpretation of visual lifelog features, such as frequent activities and events.

[1]  Deborah Estrin,et al.  Image browsing, processing, and clustering for participatory sensing: lessons from a DietSense prototype , 2007, EmNets '07.

[2]  D. Wilcox,et al.  On the analysis of cross-correlations in South African market data , 2004 .

[3]  Jessica Lin,et al.  Finding Motifs in Time Series , 2002, KDD 2002.

[4]  Ioannis P. Androulakis,et al.  Selecting maximally informative genes , 2005, Comput. Chem. Eng..

[5]  M. Crane,et al.  Random matrix theory for portfolio optimization: a stability approach , 2004 .

[6]  Irfan A. Essa,et al.  Unsupervised Activity Discovery and Characterization From Event-Streams , 2005, UAI.

[7]  Eamonn J. Keogh,et al.  Dimensionality Reduction for Fast Similarity Search in Large Time Series Databases , 2001, Knowledge and Information Systems.

[8]  V. Plerou,et al.  A random matrix theory approach to financial cross-correlations , 2000 .

[9]  Aiden R Doherty,et al.  Automatically assisting human memory: A SenseCam browser , 2011, Memory.

[10]  Alan F. Smeaton,et al.  Automatically Segmenting LifeLog Data into Events , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[11]  Alan F. Smeaton,et al.  Factorizing Time-Aware Multi-way Tensors for Enhancing Semantic Wearable Sensing , 2015, MMM.

[12]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.

[13]  Irfan A. Essa,et al.  Improving Activity Discovery with Automatic Neighborhood Estimation , 2007, IJCAI.

[14]  Kiyoharu Aizawa,et al.  Context-based video retrieval system for the life-log applications , 2003, MIR '03.

[15]  Heather J. Ruskin,et al.  Multiscaled Cross-Correlation Dynamics on SenseCam Lifelogged Images , 2013, MMM.

[16]  Alex Pentland,et al.  InSense: Interest-Based Life Logging , 2006, IEEE MultiMedia.

[17]  D. Brutlag,et al.  Highly specific protein sequence motifs for genome analysis. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Kuniaki Uehara,et al.  Discovery of Time-Series Motif from Multi-Dimensional Data Based on MDL Principle , 2005, Machine Learning.

[19]  J. Bouchaud,et al.  Noise Dressing of Financial Correlation Matrices , 1998, cond-mat/9810255.

[20]  Heather J. Ruskin,et al.  Automatically Detecting "Significant Events" on SenseCam™ , 2013, ERCIM News.

[21]  Shahram Izadi,et al.  SenseCam: A Retrospective Memory Aid , 2006, UbiComp.

[22]  V. Plerou,et al.  Universal and Nonuniversal Properties of Cross Correlations in Financial Time Series , 1999, cond-mat/9902283.

[23]  Abigail Sellen,et al.  Do life-logging technologies support memory for the past?: an experimental study using sensecam , 2007, CHI.

[24]  Kent Lyons,et al.  Capturing experiences anytime, anywhere , 2006, IEEE Pervasive Computing.

[25]  M. S. Santhanam,et al.  Quantum spectrum as a time series: fluctuation measures. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Irfan A. Essa,et al.  Discovering Characteristic Actions from On-Body Sensor Data , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[27]  Jenny Benois-Pineau,et al.  The IMMED project: wearable video monitoring of people with age dementia , 2010, ACM Multimedia.

[28]  James Fung,et al.  Designing EyeTap Digital Eyeglasses for Continuous Lifelong Capture and Sharing of Personal Experiences , 2005 .

[29]  Heather J. Ruskin,et al.  Application of statistical physics for the identification of important events in visual lifelogs , 2013, 2013 IEEE International Conference on Bioinformatics and Biomedicine.

[30]  Stphane Mallat,et al.  A Wavelet Tour of Signal Processing, Third Edition: The Sparse Way , 2008 .

[31]  I. Jánosi,et al.  Empirical mode decomposition and correlation properties of long daily ozone records. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  Li Wei,et al.  Experiencing SAX: a novel symbolic representation of time series , 2007, Data Mining and Knowledge Discovery.

[33]  J. Bouchaud,et al.  Theory of Financial Risk and Derivative Pricing: From Statistical Physics to Risk Management , 2011 .

[34]  Nebojsa Jojic,et al.  Structural epitome: a way to summarize one's visual experience , 2010, NIPS.

[35]  P. Carpena,et al.  Identifying characteristic scales in the human genome. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Wei-Hao Lin,et al.  Structuring continuous video recordings of everyday life using time-constrained clustering , 2006, Electronic Imaging.

[37]  Abul Hasan Siddiqi,et al.  Wavelet transforms of meteorological parameters and gravity waves , 2005 .

[38]  M. Ausloos,et al.  Correlation studies of open and closed state fluctuations in an ion channel: Analysis of ion current through a large-conductance locust potassium channel. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  M. Oshikawa,et al.  Random matrix theory analysis of cross correlations in financial markets. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  Alan F. Smeaton,et al.  Using visual lifelogs to automatically characterize everyday activities , 2013, Inf. Sci..

[41]  A. Dumitru,et al.  Eigenvalue repulsion in an effective theory of SU(2) Wilson lines in three dimensions , 2007, 0711.0868.

[42]  V. Plerou,et al.  Identifying Business Sectors from Stock Price Fluctuations , 2000, cond-mat/0011145.

[43]  Zhu Xizhi,et al.  The Application of Wavelet Transform in Digital Image Processing , 2008, 2008 International Conference on MultiMedia and Information Technology.