Human Context Sensing in Smart Cities

This chapter discusses the concept of human context sensing, the definitions of the four main types of human contexts, and the current technological sensing mechanisms. The types of human context sensing are physiological sensing, emotive sensing, functional sensing, and location sensing. Together, these facets capture the mental states, physical body conditions, lifestyles, and location of individuals. The goals and applications for each category unify in improving the quality of life of an individual by monitoring different aspects of life that can help the smart city provide an individual with the right level of assistance and facilities. the chapter also discusses the impact of the four main technological thrusts in each category of human context sensing: video and audio, wearables, smartphones, and environmental sensing. Each type of technology has a unique set of sensing abilities as well as constraints. Additionally, each has practical uses, costs, and privacy implications for use in a smart city.

[1]  Romit Roy Choudhury,et al.  Your reactions suggest you liked the movie: automatic content rating via reaction sensing , 2013, UbiComp.

[2]  Tadahiro Kuroda,et al.  Eating habits monitoring using wireless wearable in-ear microphone , 2008, 2008 3rd International Symposium on Wireless Pervasive Computing.

[3]  Guoliang Xing,et al.  PBN: towards practical activity recognition using smartphone-based body sensor networks , 2011, SenSys.

[4]  Gerhard Tröster,et al.  Detection of eating and drinking arm gestures using inertial body-worn sensors , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[5]  Juhi Ranjan,et al.  Discerning electrical and water usage by individuals in homes , 2014, BuildSys@SenSys.

[6]  Rodrigo Villar,et al.  Validation of the Hexoskin wearable vest during lying, sitting, standing, and walking activities. , 2015, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[7]  Gregory D. Abowd,et al.  Pervasive Computing and Autism: Assisting Caregivers of Children with Special Needs , 2007, IEEE Pervasive Computing.

[8]  Rosalind W. Picard,et al.  Automated Posture Analysis for Detecting Learner's Interest Level , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[9]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[10]  L. Hebert,et al.  Disability in basic and instrumental activities of daily living is associated with faster rate of decline in cognitive function of older adults. , 2013, The journals of gerontology. Series A, Biological sciences and medical sciences.

[11]  Paul Lukowicz,et al.  AMON: a wearable medical computer for high risk patients , 2002, Proceedings. Sixth International Symposium on Wearable Computers,.

[12]  Kwang-Ting Cheng,et al.  Energy-optimized mapping of application to smartphone platform — A case study of mobile face recognition , 2011, CVPR 2011 WORKSHOPS.

[13]  Feng Zhao,et al.  Accurate real-time occupant energy-footprinting in commercial buildings , 2012, BuildSys@SenSys.

[14]  Michael Wagner,et al.  Detecting depression: A comparison between spontaneous and read speech , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[15]  Antti Oulasvirta,et al.  Long-term effects of ubiquitous surveillance in the home , 2012, UbiComp.

[16]  Michel Lecendreux,et al.  High levels of nocturnal activity in children with attention‐deficit hyperactivity disorder: A video analysis , 2001, Psychiatry and clinical neurosciences.

[17]  Eric C. Larson,et al.  Bilicam: using mobile phones to monitor newborn jaundice , 2014, UbiComp.

[18]  Cynthia Breazeal,et al.  Affect and Inference in Bayesian Knowledge Tracing with a Robot Tutor , 2015, HRI.

[19]  Cecilia Mascolo,et al.  EmotionSense: a mobile phones based adaptive platform for experimental social psychology research , 2010, UbiComp.

[20]  E. Jovanov,et al.  Prolonged telemetric monitoring of heart rate variability using wireless intelligent sensors and a mobile gateway , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[21]  Bin Li,et al.  Identifying Logical Location via GPS-Enabled Mobile phone and Wearable Camera , 2012, Int. J. Pattern Recognit. Artif. Intell..

[22]  Brent Lance,et al.  Optimal Arousal Identification and Classification for Affective Computing Using Physiological Signals: Virtual Reality Stroop Task , 2010, IEEE Transactions on Affective Computing.

[23]  Fanglin Chen,et al.  CarSafe app: alerting drowsy and distracted drivers using dual cameras on smartphones , 2013, MobiSys 2013.

[24]  Gregory D. Abowd,et al.  The smart floor: a mechanism for natural user identification and tracking , 2000, CHI Extended Abstracts.

[25]  Toshi Takamori,et al.  Human detection and localization at indoor environment by home robot , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[26]  Deva Ramanan,et al.  Detecting activities of daily living in first-person camera views , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Thad Starner,et al.  Learning Significant Locations and Predicting User Movement with GPS , 2002, Proceedings. Sixth International Symposium on Wearable Computers,.

[28]  Yunxin Liu,et al.  MoodScope: building a mood sensor from smartphone usage patterns , 2013, MobiSys '13.

[29]  W. H. Engelmann,et al.  The National Human Activity Pattern Survey (NHAPS): a resource for assessing exposure to environmental pollutants , 2001, Journal of Exposure Analysis and Environmental Epidemiology.

[30]  John Paulin Hansen,et al.  Gaze input for mobile devices by dwell and gestures , 2012, ETRA.

[31]  Ifeyinwa E. Achumba,et al.  Monitoring: Taxonomy of Issues, Techniques, Applications, Challenges and Limitations , 2013 .

[32]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[33]  David Lo.  Multimodal Human Localization Using Bayesian Network Sensor Fusion , 2007 .

[34]  Bengisu Tulu,et al.  The smartphone as a medical device: Assessing enablers, benefits and challenges , 2013, IOT 2013.

[35]  Albrecht Schmidt,et al.  Multi-sensor Activity Context Detection for Wearable Computing , 2003, EUSAI.

[36]  Li-Chen Fu,et al.  Human Localization via Multi-Cameras and Floor Sensors in Smart Home , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[37]  J. Lebak,et al.  Implementation of a standards-based pulse oximeter on a wearable, embedded platform , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[38]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.

[39]  Liliana Grajales,et al.  Wearable multisensor heart rate monitor , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[40]  Gerard de Haan,et al.  Body movement analysis during sleep based on video motion estimation , 2013, 2013 IEEE 15th International Conference on e-Health Networking, Applications and Services (Healthcom 2013).

[41]  Eric C. Larson,et al.  SpiroSmart: using a microphone to measure lung function on a mobile phone , 2012, UbiComp.

[42]  Yang Hao,et al.  Detecting Vital Signs with Wearable Wireless Sensors , 2010, Sensors.

[43]  Sidney S. Fels,et al.  Sociotechnical Challenges and Progress in Using Social Media for Health , 2013, Journal of medical Internet research.

[44]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[45]  Aleksandar Milenkovic,et al.  System architecture of a wireless body area sensor network for ubiquitous health monitoring , 2005 .

[46]  Shyamnath Gollakota,et al.  Contactless Sleep Apnea Detection on Smartphones , 2015, GetMobile Mob. Comput. Commun..

[47]  D. Mahoney,et al.  Prototype Development of a Responsive Emotive Sensing System (DRESS) to aid older persons with dementia to dress independently. , 2014, Gerontechnology : international journal on the fundamental aspects of technology to serve the ageing society.

[48]  Cliff Randell,et al.  Sensor Sleeve: Sensing Affective Gestures , 2005 .

[49]  R. Jafari,et al.  Body sensor networks for driver distraction identification , 2008, 2008 IEEE International Conference on Vehicular Electronics and Safety.

[50]  Juhi Ranjan,et al.  Rethinking the Fusion of Technology and Clinical Practices in Functional Behavior Analysis for the Elderly , 2015, HBU.

[51]  R. B. Davis,et al.  A gait analysis data collection and reduction technique , 1991 .

[52]  Gernot Bahle,et al.  What Can an Arm Holster Worn Smart Phone Do for Activity Recognition? , 2011, 2011 15th Annual International Symposium on Wearable Computers.

[53]  Y.-K. Lee,et al.  Human Activity Recognition via an Accelerometer-Enabled-Smartphone Using Kernel Discriminant Analysis , 2010, 2010 5th International Conference on Future Information Technology.

[54]  Moustafa Youssef,et al.  No need to war-drive: unsupervised indoor localization , 2012, MobiSys '12.

[55]  P. Zimmermann,et al.  Affective Computing—A Rationale for Measuring Mood With Mouse and Keyboard , 2003, International journal of occupational safety and ergonomics : JOSE.

[56]  Kwang Suk Park,et al.  A new approach for non-intrusive monitoring of blood pressure on a toilet seat. , 2006, Physiological measurement.

[57]  E Jovanov,et al.  Patient monitoring using personal area networks of wireless intelligent sensors. , 2001, Biomedical sciences instrumentation.

[58]  Koji Tsukada,et al.  Sensing fork: eating behavior detection utensil and mobile persuasive game , 2013, CHI Extended Abstracts.

[59]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[60]  A. J. Bernheim Brush,et al.  Health chair: implicitly sensing heart and respiratory rate , 2014, UbiComp.

[61]  A. Stewart,et al.  Loss of Independence in Activities of Daily Living in Older Adults Hospitalized with Medical Illnesses: Increased Vulnerability with Age , 2003, Journal of the American Geriatrics Society.

[62]  Ramesh Raskar,et al.  NETRA: interactive display for estimating refractive errors and focal range , 2010, ACM Trans. Graph..

[63]  Kajiro Watanabe,et al.  Noninvasive measurement of heartbeat, respiration, snoring and body movements of a subject in bed via a pneumatic method , 2005, IEEE Transactions on Biomedical Engineering.

[64]  Jie Liu,et al.  A realistic evaluation and comparison of indoor location technologies: experiences and lessons learned , 2015, IPSN.

[65]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[66]  I McDowell,et al.  Multidimensionality in instrumental and basic activities of daily living. , 1998, Journal of clinical epidemiology.

[67]  Gaetano Borriello,et al.  Field evaluation of a camera-based mobile health system in low-resource settings , 2014, MobileHCI '14.

[68]  Ko Keun Kim,et al.  A Smart Health Monitoring Chair for Nonintrusive Measurement of Biological Signals , 2012, IEEE Transactions on Information Technology in Biomedicine.

[69]  Dan Feldman,et al.  iDiary: from GPS signals to a text-searchable diary , 2013, SenSys '13.

[70]  Ashutosh Sabharwal,et al.  mobileSpiro: accurate mobile spirometry for self-management of asthma , 2011, mHealthSys '11.

[71]  R. Bajcsy,et al.  Wearable Sensors for Reliable Fall Detection , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[72]  Rob Miller,et al.  3D Tracking via Body Radio Reflections , 2014, NSDI.

[73]  Rosalind W. Picard,et al.  Continuous monitoring of electrodermal activity during epileptic seizures using a wearable sensor , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[74]  Kamin Whitehouse,et al.  Doorjamb: unobtrusive room-level tracking of people in homes using doorway sensors , 2012, SenSys '12.