A Study of Detecting Social Interaction with Sensors in a Nursing Home Environment

Social interaction plays an important role in our daily lives. It is one of the most important indicators of physical or mental diseases of aging patients. In this paper, we present a Wizard of Oz study on the feasibility of detecting social interaction with sensors in skilled nursing facilities. Our study explores statistical models that can be constructed to monitor and analyze social interactions among aging patients and nurses. We are also interested in identifying sensors that might be most useful in interaction detection; and determining how robustly the detection can be performed with noisy sensors. We simulate a wide range of plausible sensors using human labeling of audio and visual data. Based on these simulated sensors, we build statistical models for both individual sensors and combinations of multiple sensors using various machine learning methods. Comparison experiments are conducted to demonstrate the effectiveness and robustness of the sensors and statistical models for detecting interactions.

[1]  Alex Pentland,et al.  Unsupervised clustering of ambulatory audio and video , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[2]  Barry Brumitt,et al.  Ubiquitous computing and the role of geometry , 2000, IEEE Wirel. Commun..

[3]  Anind K. Dey,et al.  UbiComp 2003: Ubiquitous Computing , 2003, Lecture Notes in Computer Science.

[4]  Trevor Hastie,et al.  Non‐Parametric Logistic and Proportional Odds Regression , 1987 .

[5]  Donald J. Henderson,et al.  Dementia and communication , 1991 .

[6]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[7]  Igor Kononenko,et al.  Semi-Naive Bayesian Classifier , 1991, EWSL.

[8]  Andy Hopper,et al.  The Anatomy of a Context-Aware Application , 1999, Wirel. Networks.

[9]  Lars Erik Holmquist,et al.  Supporting group collaboration with interpersonal awareness devices , 1999, Personal Technologies.

[10]  André Gilloire,et al.  High order statistics for robust speech/non-speech detection , 2000, 2000 10th European Signal Processing Conference.

[11]  G A Chase,et al.  Psychiatric symptoms and nursing home placement of patients with Alzheimer's disease. , 1990, The American journal of psychiatry.

[12]  Christopher G. Atkeson,et al.  Predicting human interruptibility with sensors: a Wizard of Oz feasibility study , 2003, CHI '03.

[13]  William T. Freeman,et al.  Orientation Histograms for Hand Gesture Recognition , 1995 .

[14]  Alex Pentland,et al.  Facial expression recognition using a dynamic model and motion energy , 1995, Proceedings of IEEE International Conference on Computer Vision.

[15]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[16]  Stanislav Kovacic,et al.  Trajectory Based Assessment of Coordinated Human Activity , 2003, ICVS.

[17]  J Nelson,et al.  The influence of environmental factors in incidents of disruptive behavior. , 1995, Journal of gerontological nursing.

[18]  Konrad Tollmar,et al.  Activity Zones for Context-Aware Computing , 2003, UbiComp.

[19]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[20]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[21]  Nicholas Emler,et al.  Gossip, reputation, and social adaptation. , 1994 .

[22]  Stan Z. Li,et al.  Real-Time Face Detection Using Boosting Learning in Hierarchical Feature Spaces , 2003 .

[23]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[24]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[25]  Gregory D. Abowd,et al.  The Aware Home: A Living Laboratory for Ubiquitous Computing Research , 1999, CoBuild.

[26]  Marko Grobelnik,et al.  Feature Selection Using Linear Support Vector Machines , 2002 .

[27]  Terrence J. Sejnowski,et al.  Unsupervised Discrimination of Clustered Data via Optimization of Binary Information Gain , 1992, NIPS.

[28]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Alex Pentland,et al.  Framing through peripheral perception , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[30]  Pat Langley,et al.  Editorial: On Machine Learning , 1986, Machine Learning.

[31]  J. Poisal,et al.  Mental Health of Medicare Beneficiaries: 1995 , 1997, Health care financing review.

[32]  B. Rovner,et al.  The role of mental morbidity in the nursing home experience. , 1992, The Gerontologist.

[33]  Bradley J. Rhodes,et al.  The wearable remembrance agent: A system for augmented memory , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[34]  Thomas G. Dietterich,et al.  Pruning Adaptive Boosting , 1997, ICML.

[35]  S. Li,et al.  Real-time face detection using boosting in hierarchical feature spaces , 2004, ICPR 2004.

[36]  N. Hooyman,et al.  Social gerontology: A multidisciplinary perspective , 1988 .