Towards Memory-Aware Services and Browsing through Lifelogging Sensing

Every day we receive lots of information through our senses that is lost forever, because it lacked the strength or the repetition needed to generate a lasting memory. Combining the emerging Internet of Things and lifelogging sensors, we believe it is possible to build up a Digital Memory (Dig-Mem) in order to complement the fallible memory of people. This work shows how to realize the Dig-Mem in terms of interactions, affinities, activities, goals and protocols. We also complement this Dig-Mem with memory-aware services and a Dig-Mem browser. Furthermore, we propose a RFID Tag-Sharing technique to speed up the adoption of Dig-Mem. Experimentation reveals an improvement of the user understanding of Dig-Mem as time passes, compared to natural memories where the level of detail decreases over time.

[1]  Fei Liu,et al.  HealthyLife: An Activity Recognition System with Smartphone Using Logic-Based Stream Reasoning , 2012, MobiQuitous.

[2]  Baik Hoh,et al.  Sell your experiences: a market mechanism based incentive for participatory sensing , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[3]  Anind K. Dey,et al.  Lifelogging memory appliance for people with episodic memory impairment , 2008, UbiComp.

[4]  Raja Parasuraman,et al.  Collecting health-related data on the smart phone: mental models, cost of collection, and perceived benefit of feedback , 2012, Personal and Ubiquitous Computing.

[5]  M. Shermer.  God's number is up. , 2004, Scientific American.

[6]  John Bigham,et al.  Recognising activities of daily life through the usage of everyday objects around the home , 2009, 2009 3rd International Conference on Pervasive Computing Technologies for Healthcare.

[7]  David C. Rubin,et al.  Autobiographical memory: Introduction , 1986 .

[8]  Abigail Sellen,et al.  Do life-logging technologies support memory for the past?: an experimental study using sensecam , 2007, CHI.

[9]  Margaret E. Morris,et al.  Embedded Assessment: Overcoming Barriers to Early Detection with Pervasive Computing , 2005, Pervasive.

[10]  Barbara A. Wilson,et al.  External memory aids and computers in memory rehabilitation , 2002 .

[11]  Alan F. Smeaton,et al.  Experiences of Aiding Autobiographical Memory Using the SenseCam , 2012, Hum. Comput. Interact..

[12]  Andre Gustavo Adami,et al.  An Electronic Pillbox for Continuous Monitoring of Medication Adherence , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Anind K. Dey,et al.  Reflecting on pills and phone use: supporting awareness of functional abilities for older adults , 2011, CHI.

[14]  Jinyan Li,et al.  Mining statistically important equivalence classes and delta-discriminative emerging patterns , 2007, KDD '07.

[15]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[16]  Hongbo Jiang,et al.  Mobile and Ubiquitous Systems: Computing, Networking, and Services , 2011, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.

[17]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[18]  Jian Lu,et al.  Mining Emerging Patterns for recognizing activities of multiple users in pervasive computing , 2009, 2009 6th Annual International Mobile and Ubiquitous Systems: Networking & Services, MobiQuitous.

[19]  Feng Zhao.  Sensornet 2.0: The New Frontier , 2006, 2006 27th IEEE International Real-Time Systems Symposium (RTSS'06).

[20]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[21]  Shahram Izadi,et al.  SenseCam: A Retrospective Memory Aid , 2006, UbiComp.

[22]  Henry A. Kautz,et al.  Inferring activities from interactions with objects , 2004, IEEE Pervasive Computing.

[23]  Eric Paulos,et al.  inAir: measuring and visualizing indoor air quality , 2009, UbiComp.

[24]  Felix Wortmann,et al.  Internet of Things , 2015, Business & Information Systems Engineering.

[25]  Daniela Petrelli,et al.  Family memories in the home: contrasting physical and digital mementos , 2010, Personal and Ubiquitous Computing.

[26]  Jian Lu,et al.  epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[27]  Li Cui,et al.  EasiTia: A Pervasive Traffic Information Acquisition System Based on Wireless Sensor Networks , 2011, IEEE Transactions on Intelligent Transportation Systems.

[28]  Prashant J. Shenoy,et al.  Ferret: RFID Localization for Pervasive Multimedia , 2006, UbiComp.

[29]  Kiyoharu Aizawa,et al.  Context-based video retrieval system for the life-log applications , 2003, MIR '03.

[30]  Jinyan Li,et al.  Efficient mining of emerging patterns: discovering trends and differences , 1999, KDD '99.

[31]  Paul D. Clough,et al.  Easy on that trigger dad: a study of long term family photo retrieval , 2009, Personal and Ubiquitous Computing.

[32]  Lida Xu,et al.  The internet of things: a survey , 2014, Information Systems Frontiers.

[33]  Wolfgang Kellerer,et al.  The sensor internet at work: Locating everyday items using mobile phones , 2008, Pervasive Mob. Comput..

[34]  Prashant J. Shenoy,et al.  Sherlock: automatically locating objects for humans , 2008, MobiSys '08.

[35]  Abigail Sellen,et al.  Beyond total capture , 2010, Commun. ACM.

[36]  Andrew Sears,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2002, CHI 2002.

[37]  Henry Lieberman,et al.  End-User Development (Human-Computer Interaction Series) , 2006 .

[38]  Wolfgang Kellerer,et al.  Objects Calling Home: Locating Objects Using Mobile Phones , 2007, Pervasive.

[39]  Martha E. Pollack,et al.  Autominder: an intelligent cognitive orthotic system for people with memory impairment , 2003, Robotics Auton. Syst..