Monitoring activity of taking medicine by incorporating RFID and video analysis

In this paper, we present a new framework to monitor medication intake for elderly individuals by incorporating a video camera and radio frequency identification (RFID) sensors. The proposed framework can provide a key function for monitoring activities of daily living (ADLs) of elderly people at their own home. In an assistive environment, RFID tags are applied on medicine bottles located in a medicine cabinet so that each medicine bottle will have a unique ID. The description of the medicine data for each tag is manually input to a database. RFID readers will detect if any of these bottles are taken away from the medicine cabinet and identify the tag attached on the medicine bottle. A video camera is installed to continue monitoring the activity of taking medicine by integrating face detection and tracking, mouth detection, background subtraction, and activity detection. The preliminary results demonstrate that 100 % detection accuracy for identifying medicine bottles and promising results for monitoring activity of taking medicine.

[1]  Christopher Joseph Pal,et al.  Activity recognition using the velocity histories of tracked keypoints , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  Jun Rekimoto,et al.  CyberCode: designing augmented reality environments with visual tags , 2000, DARE '00.

[4]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  John Nicholson,et al.  RoboCart: toward robot-assisted navigation of grocery stores by the visually impaired , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Nak Young Chong,et al.  Knowledge Distributed Tag-Based Vision System , 2004 .

[8]  Kay Römer,et al.  Smart identification frameworks for ubiquitous computing applications , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[9]  Hidekata Hontani,et al.  Visual tracking system using an ID-tag and the network , 2003, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[10]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[11]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[12]  Sethuraman Panchanathan,et al.  Distal object perception through haptic user interfaces , 2006 .

[13]  Vijaya L. Melnick,et al.  Alzheimer’s Dementia , 1985, Contemporary Issues in Biomedicine, Ethics, and Society.

[14]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[15]  S. Kotsopoulos,et al.  Design and Development , 2015 .

[16]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[17]  Shigeru Ando,et al.  A computer vision system for knowledge-based 3D scene analysis using radio-frequency tags , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[18]  G. Fuller,et al.  Falls in the elderly. , 2000, American family physician.

[19]  Arnold W. M. Smeulders,et al.  Color-based object recognition , 1997, Pattern Recognit..

[20]  Takeo Kanade,et al.  A statistical approach to 3d object detection applied to faces and cars , 2000 .

[21]  Gary R. Bradski,et al.  Real time face and object tracking as a component of a perceptual user interface , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[22]  Andrew Bolton.  Design and development , 1999 .

[23]  John Krumm,et al.  Object recognition with color cooccurrence histograms , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[24]  Guillaume Bouchard,et al.  A Hierarchical Part-Based Model for Visual Object Categorization , 2005, CVPR 2005.

[25]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[26]  Giancarlo Iannizzotto,et al.  Badge3D for Visually Impaired , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[27]  R Brookmeyer,et al.  Projections of Alzheimer's disease in the United States and the public health impact of delaying disease onset. , 1998, American journal of public health.

[28]  Tomaso A. Poggio,et al.  A Trainable System for Object Detection , 2000, International Journal of Computer Vision.

[29]  Luigi di Stefano,et al.  Real-Time Stereo within the VIDET Project , 2002, Real Time Imaging.

[30]  Sethuraman Panchanathan,et al.  Distal object perception through haptic user interfaces for individuals who are blind , 2006, ASAC.

[31]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[32]  Tatsuo Arai,et al.  Object recognition using appearance models accumulated into environment , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[33]  Kathryn Ziegler-Graham,et al.  Forecasting the global burden of Alzheimer’s disease , 2007, Alzheimer's & Dementia.

[34]  Antonio Torralba,et al.  Context-based vision system for place and object recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[35]  H Burkhardt,et al.  Recognition of Artiicial 3-d Landmarks from Depth and Color | a Rst Prototype of Electronic Glasses for Blind People , .

[36]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[37]  Takeo Kanade,et al.  Human Face Detection in Visual Scenes , 1995, NIPS.

[38]  Abdelsalam Helal,et al.  RFID information grid for blind navigation and wayfinding , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[39]  Nak Young Chong,et al.  Robots on self-organizing knowledge networks , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[40]  Takeo Kanade,et al.  Bayesian color constancy for outdoor object recognition , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[41]  Thomas Ertl,et al.  Design and development of an indoor navigation and object identification system for the blind , 2004, Assets '04.

[42]  Pietro Perona,et al.  A sparse object category model for efficient learning and exhaustive recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).