Interactions with recognized patients using smart glasses

Recently, different smart glasses solutions have been proposed on the market. The rapid development of this wearable technology has led to several research projects related to applications of smart glasses in healthcare. In this paper we propose a general architecture of the system enabling data integration for the recognized person. In the proposed system smart glasses integrates data obtained for the recognized patient from health care information systems, from devices connected to the patient and from the patient himself. The data integration is possible, if proper patient recognition procedure is used. Therefore, we evaluated three identification methods based on face recognition and using the recognition of graphical markers (i.e. QR-codes and proposed color-based codes). The results show that it is possible to obtain reliable and fast recognition results during the video acquisition by the smart glasses camera.

[1]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[2]  Hazem Wannous,et al.  Enhanced Assessment of the Wound-Healing Process by Accurate Multiview Tissue Classification , 2011, IEEE Transactions on Medical Imaging.

[3]  Krzysztof Z. Gajos,et al.  Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces , 2008, CHI.

[4]  M. Hahnel,et al.  Color and texture features for person recognition , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[5]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[6]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Junwei Han,et al.  Automatic skin segmentation and tracking in sign language recognition , 2009 .

[8]  Artur Polinski,et al.  Color transformation methods for dichromats , 2010, 3rd International Conference on Human System Interaction.

[9]  Krzysztof Czuszynski,et al.  Interaction with medical data using QR-codes , 2014, 2014 7th International Conference on Human System Interactions (HSI).

[10]  Luis González Abril,et al.  Discrete techniques applied to low-energy mobile human activity recognition. A new approach , 2014, Expert Syst. Appl..

[11]  Constantine Stephanidis,et al.  Developing dual user interfaces for integrating blind and sighted users: the HOMER UIMS , 1995, CHI '95.

[12]  Jeffrey Nichols,et al.  Huddle: automatically generating interfaces for systems of multiple connected appliances , 2006, UIST.

[13]  Wolf-Joachim Fischer,et al.  Food Intake Monitoring: Automated Chew Event Detection in Chewing Sounds , 2014, IEEE Journal of Biomedical and Health Informatics.

[14]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[15]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[16]  Xingming Zheng,et al.  Color recognition of clothes based on k-means and mean shift , 2012, 2012 IEEE International Conference on Intelligent Control, Automatic Detection and High-End Equipment.

[17]  Jacek Ruminski,et al.  Interactions with recognized objects , 2014, 2014 7th International Conference on Human System Interactions (HSI).

[18]  Krzysztof Czuszynski,et al.  Application of smart glasses for fast and automatic color correction in health care , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Xu Zhang,et al.  Evaluation of Color Similarity Descriptors for Human Action Recognition , 2014, ICIMCS '14.

[20]  Chimay J. Anumba,et al.  Radio-Frequency Identification (RFID) applications: A brief introduction , 2007, Adv. Eng. Informatics.

[21]  Yue Liu,et al.  Automatic Recognition Algorithm of Quick Response Code Based on Embedded System , 2006, Sixth International Conference on Intelligent Systems Design and Applications.