Multimedia sensors embedded in smartphones for ambient assisted living and e-health

Nowadays, it is widely extended the use of smartphones to make human life more comfortable. Moreover, there is a special interest on Ambient Assisted Living (AAL) and e-Health applications. The sensor technology is growing and amount of embedded sensors in the smartphones can be very useful for AAL and e-Health. While some sensors like the accelerometer, gyroscope or light sensor are very used in applications such as motion detection or light meter, there are other ones, like the microphone and camera which can be used as multimedia sensors. This paper reviews the published papers focused on showing proposals, designs and deployments of that make use of multimedia sensors for AAL and e-health. We have classified them as a function of their main use. They are the sound gathered by the microphone and image recorded by the camera. We also include a comparative table and analyze the gathered information.

[1]  Mohsen Guizani,et al.  A Survey on Energy Harvesting and Integrated Data Sharing in Wireless Body Area Networks , 2015, Int. J. Distributed Sens. Networks.

[2]  Alexandros André Chaaraoui,et al.  A review on vision techniques applied to Human Behaviour Analysis for Ambient-Assisted Living , 2012, Expert Syst. Appl..

[3]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[4]  Daqiang Zhang,et al.  Predicting Mobile Phone User Locations by Exploiting Collective Behavioral Patterns , 2012, 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing.

[5]  Xiao Su,et al.  A smartphone design approach to user communication interface for administering storage system network , 2012, 2012 IEEE International Conference on Communications (ICC).

[6]  Athanasios V. Vasilakos,et al.  Predicting location using mobile phone calls , 2012, CCRV.

[7]  Shervin Shirmohammadi,et al.  Tele-Medical Applications in Home-Based Health Care , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[8]  Illhoi Yoo,et al.  A Systematic Review of Healthcare Applications for Smartphones , 2012, BMC Medical Informatics and Decision Making.

[9]  Frank Bomarius,et al.  An Event-Driven Approach to Activity Recognition in Ambient Assisted Living , 2009, AmI.

[10]  Abhilasha Tyagi,et al.  e-Health Tools for Targeting and Improving Melanoma Screening: A Review , 2012, Journal of skin cancer.

[11]  Rui Hu,et al.  Implementation of the 7-point checklist for melanoma detection on smart handheld devices , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Andrei Bursuc,et al.  A Smartphone-Based Obstacle Detection and Classification System for Assisting Visually Impaired People , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[13]  Pierre-Yves Gumery,et al.  iBalance-ABF: A Smartphone-Based Audio-Biofeedback Balance System , 2013, IEEE Transactions on Biomedical Engineering.

[14]  Fabien Cardinaux,et al.  Video based technology for ambient assisted living: A review of the literature , 2011, J. Ambient Intell. Smart Environ..

[15]  Hanghang Tong,et al.  Activity recognition with smartphone sensors , 2014 .

[16]  Jaime Lloret,et al.  Intelligent IPTV Distribution for Smart Phones , 2013 .

[17]  Toni Janevski,et al.  Protocols and Algorithms for the Next Generation 5G Mobile Systems , 2011, Netw. Protoc. Algorithms.

[18]  James A. J. Heathers,et al.  Smartphone-enabled pulse rate variability: an alternative methodology for the collection of heart rate variability in psychophysiological research. , 2013, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[19]  Joel J. P. C. Rodrigues,et al.  A hybrid NFC-Bluetooth secure protocol for Credit Transfer among mobile phones , 2014, Secur. Commun. Networks.

[20]  Jaime Lloret,et al.  Mobile Sensing Systems , 2013, Sensors.

[21]  Cathal Gurrin,et al.  The smartphone as a platform for wearable cameras in health research. , 2013, American journal of preventive medicine.

[22]  Rahim Tafazolli,et al.  A survey on smartphone-based systems for opportunistic user context recognition , 2013, CSUR.

[23]  Fadi A. Aloul,et al.  Sleep Apnea Monitoring using mobile phones , 2012, 2012 IEEE 14th International Conference on e-Health Networking, Applications and Services (Healthcom).

[24]  Eric C. Larson,et al.  SpiroSmart: using a microphone to measure lung function on a mobile phone , 2012, UbiComp.

[25]  Steve Wheeler,et al.  How smartphones are changing the face of mobile and participatory healthcare: an overview, with example from eCAALYX , 2011, Biomedical engineering online.

[26]  Domenico Grimaldi,et al.  Photoplethysmography detection by smartphone's videocamera , 2011, Proceedings of the 6th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems.

[27]  Till Halbach,et al.  What Seniors Want in a Mobile Help-on-Demand Service , 2013, eTELEMED 2013.

[28]  Li Zhang,et al.  An intelligent mobile based decision support system for retinal disease diagnosis , 2014, Decis. Support Syst..

[29]  G. Anderson,et al.  The Growing Burden of Chronic Disease in America , 2004, Public health reports.

[30]  Martin Maier,et al.  Context awareness in WBANs: a survey on medical and non-medical applications , 2013, IEEE Wireless Communications.

[31]  Rafael Estepa,et al.  Dynamic VoIP codec selection on smartphones , 2014, Netw. Protoc. Algorithms.

[32]  Miguel Garcia,et al.  Architecture and Protocol of a Semantic System Designed for Video Tagging with Sensor Data in Mobile Devices , 2012, Sensors.

[33]  Sri Hastuti Kurniawan,et al.  Older people and mobile phones: A multi-method investigation , 2008, Int. J. Hum. Comput. Stud..

[34]  M. Shamim Hossain,et al.  Context-aware multimedia services modeling: an e-Health perspective , 2013, Multimedia Tools and Applications.

[35]  Elsa M. Macías,et al.  Full Geo-localized Mobile Video in Android Mobile Telephones , 2011, Netw. Protoc. Algorithms.

[36]  Daqiang Zhang,et al.  NextCell: Predicting Location Using Social Interplay from Cell Phone Traces , 2015, IEEE Transactions on Computers.

[37]  D. McGranahan,et al.  Ecology, Evolution and Organismal Biology Publications Ecology, Evolution and Organismal Biology Connecting Soil Organic Carbon and Root Biomass with Land-use and Vegetation in Temperate Grassland Connecting Soil Organic Carbon and Root Biomass with Land-use and Vegetation in Temperate Grassland , 2022 .

[38]  Zeashan Hameed Khan,et al.  A Systematic Approach for Developing Mobile Information System based on Location Based Services , 2010, Netw. Protoc. Algorithms.

[39]  Daniël Lakens,et al.  Using a Smartphone to Measure Heart Rate Changes during Relived Happiness and Anger , 2013, IEEE Transactions on Affective Computing.

[40]  Anita Silvers,et al.  Americans with Disabilities , 2015 .

[41]  Paolo Dario,et al.  Ambient Assisted Living and ageing: Preliminary results of RITA project , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  Jaime Lloret,et al.  Spontaneous Ad Hoc Mobile Cloud Computing Network , 2014, TheScientificWorldJournal.

[43]  Edward D. Lemaire,et al.  Wearable Mobility Monitoring Using a Multimedia Smartphone Platform , 2011, IEEE Transactions on Instrumentation and Measurement.

[44]  Joel J. P. C. Rodrigues,et al.  Smart Collaborative Mobile System for Taking Care of Disabled and Elderly People , 2014, Mob. Networks Appl..

[45]  Urs-Vito Albrecht,et al.  Mobile Technologies: Expectancy, Usage, and Acceptance of Clinical Staff and Patients at a University Medical Center , 2014, JMIR mHealth and uHealth.

[46]  Shahriar Akter,et al.  mHealth Technologies for Chronic Diseases and Elders: A Systematic Review , 2013, IEEE Journal on Selected Areas in Communications.

[47]  Miguel Garcia,et al.  A Cluster-Based Architecture to Structure the Topology of Parallel Wireless Sensor Networks , 2009, Sensors.

[48]  Hao-Hua Chu,et al.  Listen-to-nose: a low-cost system to record nasal symptoms in daily life , 2012, UbiComp '12.

[49]  Richard Tynan,et al.  Towards evolutionary ambient assisted living systems , 2010, J. Ambient Intell. Humaniz. Comput..

[50]  M. Brault.  Americans with Disabilities: 2010 , 2012 .

[51]  Cem Ersoy,et al.  Wireless sensor networks for healthcare: A survey , 2010, Comput. Networks.

[52]  Pierfrancesco Bellini,et al.  Mobile Medicine: semantic computing management for health care applications on desktop and mobile devices , 2012, Multimedia Tools and Applications.

[53]  Ki H. Chon,et al.  Atrial fibrillation detection using a smart phone , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[54]  Athanasios V. Vasilakos,et al.  A Survey on Ambient Intelligence in Healthcare , 2013, Proceedings of the IEEE.

[55]  Thomas Martin Deserno,et al.  Urban Positioning Using Smartphone-Based Imaging , 2014, Bildverarbeitung für die Medizin.

[56]  Martina Mueller,et al.  Development and Validation of a Smartphone Heart Rate Acquisition Application for Health Promotion and Wellness Telehealth Applications , 2012, International journal of telemedicine and applications.

[57]  Keiji Yanai,et al.  FoodCam: A real-time food recognition system on a smartphone , 2015, Multimedia Tools and Applications.

[58]  Mohammed Feham,et al.  M-Health: Skin Disease Analysis System Using Smartphone's Camera , 2013, ANT/SEIT.

[59]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[60]  Eiman Kanjo.  Tools and Architectural support for Mobile Phones based Crowd Control Systems , 2012, Netw. Protoc. Algorithms.