Personal search system based on android using lifelog and machine learning

Lifelog is the foundation on which lifelong services and healthcare services are implemented in a smart home system. It also plays a major role in the sub-processes of the system because it acquires information about the home’s residents for home automation and entertainment. Providing personalized services to individuals by acquiring and managing this personal lifelog information has great advantages in terms of service satisfaction and effectiveness. In this paper, we implemented a personal search system based on android that collected and stored an individual’s lifelog based on nine smart phone sensors and used it to derive new meaningful information about the user. The activity recognition module for classifying the user’s behavior, the naive Bayesian method, showed an accuracy of 88.23% and the area under the ROC curve value of 0.941. We designed and implemented density-based spatial clustering method in the module for extracting the point of interest and the participants filled out a satisfaction questionnaire to evaluate the search system. The proposed system efficiently uses a large amount of lifelog data and automates the process of extracting meaningful information, associating it according to the user’s intention.

[1]  R. Doyle The American terrorist. , 2001, Scientific American.

[2]  Naoyuki Kubota,et al.  Informationally Structured Space for Life Log Monitoring in Elderly Care , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[3]  Deokjai Choi,et al.  Modeling and discovering human behavior from smartphone sensing life-log data for identification purpose , 2015, Human-centric Computing and Information Sciences.

[4]  Li-Chen Fu,et al.  Context-aware activity prediction using human behavior pattern in real smart home environments , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[5]  James A. Hendler,et al.  SHOE: A Blueprint for the Semantic Web , 2003, Spinning the Semantic Web.

[6]  Balqies Sadoun,et al.  The BAU GIS system using open source mapwindow , 2015, Human-centric Computing and Information Sciences.

[7]  Giuseppe Scanniello,et al.  LifeBook: A Mobile Personal Information Management System on the Cloud , 2016, AVI.

[8]  Shaharyar Kamal,et al.  Real-time life logging via a depth silhouette-based human activity recognition system for smart home services , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[9]  Steve Hodges,et al.  SenseCam: A wearable camera that stimulates and rehabilitates autobiographical memory , 2011, Memory.

[10]  Wendy Hall,et al.  The Semantic Web Revisited , 2006, IEEE Intelligent Systems.

[11]  Lan Chen,et al.  Semantic Link Network-Based Model for Organizing Multimedia Big Data , 2014, IEEE Transactions on Emerging Topics in Computing.

[12]  Chaitali Chakrabarti,et al.  Lifelogging: Archival and retrieval of continuously recorded audio using wearable devices , 2012, 2012 IEEE International Conference on Emerging Signal Processing Applications.

[13]  Ngai-Man Cheung,et al.  Smartphone and Mobile Image Processing for Assisted Living: Health-monitoring apps powered by advanced mobile imaging algorithms , 2016, IEEE Signal Processing Magazine.

[14]  Alan F. Smeaton,et al.  Passively recognising human activities through lifelogging , 2011, Comput. Hum. Behav..

[15]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.

[16]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[17]  Mikhail Belkin,et al.  Automatic Annotation of Daily Activity from Smartphone-Based Multisensory Streams , 2012, MobiCASE.

[18]  Steffen Staab,et al.  Ontology Learning for the Semantic Web , 2002, IEEE Intell. Syst..

[19]  Hiroaki Ogata,et al.  Ubiquitous Learning Project Using Life-logging Technology in Japan , 2014, J. Educ. Technol. Soc..