Finding Motifs in Large Personal Lifelogs

The term Visual Lifelogging is used to describe the process of tracking personal activities by using wearable cameras. A typical example of wearable cameras is Microsoft's SenseCam that can capture vast personal archives per day. A significant challenge is to organise and analyse such large volumes of lifelogging data. State-of-the-art techniques use supervised machine learning techniques to search and retrieve useful information, which requires prior knowledge about the data. We argue that these so-called rule-based and concept-based techniques may not offer the best solution for analysing large and unstructured collections of visual lifelogs. Treating lifelogs as time series data, we study in this paper how motifs techniques can be used to identify repeating events. We apply the Minimum Description Length (MDL) method to extract multi-dimensional motifs in time series data. Our initial results suggest that motifs analysis provides a useful probe for identification and interpretation of visual lifelog features, such as frequent activities and events.

[1]  Zhu Xizhi,et al.  The Application of Wavelet Transform in Digital Image Processing , 2008, 2008 International Conference on MultiMedia and Information Technology.

[2]  Li Wei,et al.  Experiencing SAX: a novel symbolic representation of time series , 2007, Data Mining and Knowledge Discovery.

[3]  Kuniaki Uehara,et al.  Discovery of Time-Series Motif from Multi-Dimensional Data Based on MDL Principle , 2005, Machine Learning.

[4]  W. Breymann Theory of Financial Risk and Derivative Pricing: From Statistical Physics to Risk Management , 2006 .

[5]  V. Plerou,et al.  Universal and Nonuniversal Properties of Cross Correlations in Financial Time Series , 1999, cond-mat/9902283.

[6]  P. Carpena,et al.  Identifying characteristic scales in the human genome. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Irfan A. Essa,et al.  Improving Activity Discovery with Automatic Neighborhood Estimation , 2007, IJCAI.

[8]  Kiyoharu Aizawa,et al.  Context-based video retrieval system for the life-log applications , 2003, MIR '03.

[9]  M. Ausloos,et al.  Correlation studies of open and closed state fluctuations in an ion channel: Analysis of ion current through a large-conductance locust potassium channel. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  I. Jánosi,et al.  Empirical mode decomposition and correlation properties of long daily ozone records. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Irfan A. Essa,et al.  Unsupervised Activity Discovery and Characterization From Event-Streams , 2005, UAI.

[12]  Aiden R Doherty,et al.  Automatically assisting human memory: A SenseCam browser , 2011, Memory.

[13]  Stphane Mallat,et al.  A Wavelet Tour of Signal Processing, Third Edition: The Sparse Way , 2008 .

[14]  Heather J. Ruskin,et al.  Automatically Detecting "Significant Events" on SenseCam™ , 2013, ERCIM News.

[15]  M. Oshikawa,et al.  Random matrix theory analysis of cross correlations in financial markets. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  David R. Brillinger,et al.  Time Series , 2018, Randomization, Bootstrap and Monte Carlo Methods in Biology.

[17]  Alex Pentland,et al.  InSense: Interest-Based Life Logging , 2006, IEEE MultiMedia.

[18]  Shahram Izadi,et al.  SenseCam: A Retrospective Memory Aid , 2006, UbiComp.

[19]  Steve Mann,et al.  Continuous lifelong capture of personal experience with EyeTap , 2004, CARPE'04.

[20]  D. Brutlag,et al.  Highly specific protein sequence motifs for genome analysis. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[21]  V. Plerou,et al.  Identifying Business Sectors from Stock Price Fluctuations , 2000, cond-mat/0011145.

[22]  J. Bouchaud,et al.  Noise Dressing of Financial Correlation Matrices , 1998, cond-mat/9810255.

[23]  Jessica Lin,et al.  Finding Motifs in Time Series , 2002, KDD 2002.

[24]  D. Wilcox,et al.  On the analysis of cross-correlations in South African market data , 2004 .

[25]  James Fung,et al.  Designing EyeTap Digital Eyeglasses for Continuous Lifelong Capture and Sharing of Personal Experiences , 2005 .

[26]  Alan F. Smeaton,et al.  Factorizing Time-Aware Multi-way Tensors for Enhancing Semantic Wearable Sensing , 2015, MMM.

[27]  Irfan A. Essa,et al.  Discovering Characteristic Actions from On-Body Sensor Data , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[28]  Deborah Estrin,et al.  Image browsing, processing, and clustering for participatory sensing: lessons from a DietSense prototype , 2007, EmNets '07.

[29]  Jenny Benois-Pineau,et al.  The IMMED project: wearable video monitoring of people with age dementia , 2010, ACM Multimedia.

[30]  V. Plerou,et al.  A random matrix theory approach to financial cross-correlations , 2000 .

[31]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.

[32]  Abigail Sellen,et al.  Do life-logging technologies support memory for the past?: an experimental study using sensecam , 2007, CHI.

[33]  J. Bouchaud,et al.  Theory of Financial Risk and Derivative Pricing: From Statistical Physics to Risk Management , 2011 .

[34]  Heather J. Ruskin,et al.  Application of statistical physics for the identification of important events in visual lifelogs , 2013, 2013 IEEE International Conference on Bioinformatics and Biomedicine.

[35]  Eamonn J. Keogh,et al.  Dimensionality Reduction for Fast Similarity Search in Large Time Series Databases , 2001, Knowledge and Information Systems.

[36]  A. Dumitru,et al.  Eigenvalue repulsion in an effective theory of SU(2) Wilson lines in three dimensions , 2007, 0711.0868.

[37]  Heather J. Ruskin,et al.  Multiscaled Cross-Correlation Dynamics on SenseCam Lifelogged Images , 2013, MMM.

[38]  Alan F. Smeaton,et al.  Using visual lifelogs to automatically characterize everyday activities , 2013, Inf. Sci..

[39]  M. Crane,et al.  Random matrix theory for portfolio optimization: a stability approach , 2004 .

[40]  Abul Hasan Siddiqi,et al.  Wavelet transforms of meteorological parameters and gravity waves , 2005 .

[41]  Alan F. Smeaton,et al.  Automatically Segmenting LifeLog Data into Events , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[42]  Wei-Hao Lin,et al.  Structuring continuous video recordings of everyday life using time-constrained clustering , 2006, Electronic Imaging.

[43]  V. Plerou,et al.  Quantifying and interpreting collective behavior in financial markets. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  Kent Lyons,et al.  Capturing experiences anytime, anywhere , 2006, IEEE Pervasive Computing.

[45]  Nebojsa Jojic,et al.  Structural epitome: a way to summarize one's visual experience , 2010, NIPS.

[46]  M. S. Santhanam,et al.  Quantum spectrum as a time series: fluctuation measures. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  Ioannis P. Androulakis,et al.  Selecting maximally informative genes , 2005, Comput. Chem. Eng..