Personalized gesture interactions for cyber-physical smart-home environments

AbstractA gesture-based interaction system for smart homes is a part of a complex cyber-physical environment, for which researchers and developers need to address major challenges in providing personalized gesture interactions. However, current research efforts have not tackled the problem of personalized gesture recognition that often involves user identification. To address this problem, we propose in this work a new event-driven service-oriented framework called gesture services for cyber-physical environments (GS-CPE) that extends the architecture of our previous work gesture profile for web services (GPWS). To provide user identification functionality, GS-CPE introduces a two-phase cascading gesture password recognition algorithm for gesture-based user identification using a two-phase cascading classifier with the hidden Markov model and the Golden Section Search, which achieves an accuracy rate of 96.2% with a small training dataset. To support personalized gesture interaction, an enhanced version of the Dynamic Time Warping algorithm with multiple gestural input sources and dynamic template adaptation support is implemented. Our experimental results demonstrate the performance of the algorithm can achieve an average accuracy rate of 98.5% in practical scenarios. Comparison results reveal that GS-CPE has faster response time and higher accuracy rate than other gesture interaction systems designed for smart-home environments.创新点1. 论文设计了一个支持智能家庭环境中个性化手势交互的集成框架GS-CPE,该框架同时集成了用户身份识别与个性化手势识别,通过服务的形式提供了一组简单易用的API。 2. 论文提出了一种可用于用户身份识别的手势识别算法。通过结合基于统计模型的HMM分类器及基于模板匹配的GSS分类器,该算法可在训练数据集有限的条件下较大幅度地提高手势密码的识别准确率。 3. 论文提出了一种融合多数据源的个性化手势识别算法,通过对比来自不同数据源的手势识别结果来消除对拒绝似然比的依赖,并针对实际环境设计了手势模板动态调节方法,从而提高了该算法的识别准确率。

[1]  Manfred Tscheligi,et al.  Trends in the living room and beyond: results from ethnographic studies using creative and playful probing , 2008, CIE.

[2]  Radu-Daniel Vatavu A comparative study of user-defined handheld vs. freehand gestures for home entertainment environments , 2013, J. Ambient Intell. Smart Environ..

[3]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[4]  Maojun Zhang,et al.  An application oriented and shape feature based multi-touch gesture description and recognition method , 2011, Multimedia Tools and Applications.

[5]  Radu-Daniel Vatavu,et al.  Formalizing Agreement Analysis for Elicitation Studies: New Measures, Significance Test, and Toolkit , 2015, CHI.

[6]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[7]  Radu-Daniel Vatavu,et al.  Gestures as point clouds: a $P recognizer for user interface prototypes , 2012, ICMI '12.

[8]  Sergio Escalera,et al.  Featureweighting in dynamic timewarping for gesture recognition in depth data , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[9]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[10]  Josef Kittler,et al.  Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications , 2015 .

[11]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[12]  Hui Li,et al.  Kinect Based Dynamic Hand Gesture Recognition Algorithm Research , 2012, 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics.

[13]  Jun Zhang,et al.  Weight-based sparse coding for multi-shot person re-identification , 2015, Science China Information Sciences.

[14]  Xuelong Li,et al.  Query-Adaptive Reciprocal Hash Tables for Nearest Neighbor Search , 2016, IEEE Transactions on Image Processing.

[15]  Galen Panger Kinect in the kitchen: testing depth camera interactions in practical home environments , 2012, CHI EA '12.

[16]  Xuelong Li,et al.  Large-Scale Unsupervised Hashing with Shared Structure Learning , 2015, IEEE Transactions on Cybernetics.

[17]  Wei-Tek Tsai,et al.  Gesture Profile for Web Services: An Event-Driven Architecture to Support Gestural Interfaces for Smart Environments , 2012, AmI.

[18]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[19]  Wei-Tek Tsai,et al.  Gesture ontology for informing Service-oriented Architecture , 2012, 2012 IEEE International Symposium on Intelligent Control.

[20]  Brad A. Myers,et al.  Maximizing the guessability of symbolic input , 2005, CHI Extended Abstracts.

[21]  Joan Climent,et al.  A Performance Evaluation of HMM and DTW for Gesture Recognition , 2012, CIARP.

[22]  Jason I. Hong,et al.  Wave to me: user identification using body lengths and natural gestures , 2014, CHI.

[23]  L. R. Rabiner,et al.  A comparative study of several dynamic time-warping algorithms for connected-word recognition , 1981, The Bell System Technical Journal.

[24]  Radu-Daniel Vatavu Point & click mediated interactions for large home entertainment displays , 2010, Multimedia Tools and Applications.

[25]  Wenjun Wu,et al.  A Personalized Gesture Interaction System with User Identification Using Kinect , 2014, PRICAI.

[26]  J. Kiefer,et al.  Sequential minimax search for a maximum , 1953 .

[27]  Yang Li,et al.  User-defined motion gestures for mobile interaction , 2011, CHI.

[28]  Biing-Hwang Juang,et al.  6DMG: a new 6D motion gesture database , 2012, MMSys '12.

[29]  Chi-Man Pun,et al.  Real-time Hand Gesture Recognition from Depth Image Sequences , 2012, 2012 Ninth International Conference on Computer Graphics, Imaging and Visualization.

[30]  Radu-Daniel Vatavu,et al.  User-defined gestures for free-hand TV control , 2012, EuroITV.

[31]  Filip De Turck,et al.  WS-Gesture, a gesture-based state-aware control framework , 2010, 2010 IEEE International Conference on Service-Oriented Computing and Applications (SOCA).

[32]  A. B. M. Shawkat Ali,et al.  HMM based hand gesture recognition: A review on techniques and approaches , 2009, 2009 2nd IEEE International Conference on Computer Science and Information Technology.

[33]  Radu-Daniel Vatavu,et al.  Leap gestures for TV: insights from an elicitation study , 2014, TVX.

[34]  Radu-Daniel Vatavu,et al.  Nomadic gestures: A technique for reusing gesture commands for frequent ambient interactions , 2012, J. Ambient Intell. Smart Environ..

[35]  Sebastian Möller,et al.  I'm home: Defining and evaluating a gesture set for smart-home control , 2011, Int. J. Hum. Comput. Stud..

[36]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[37]  Zhaohui Wu,et al.  GeeAir: a universal multimodal remote control device for home appliances , 2010, Personal and Ubiquitous Computing.

[38]  Wei-Tek Tsai,et al.  Service-oriented smart home applications: composition, code generation, deployment, and execution , 2011, Service Oriented Computing and Applications.

[39]  Ting Yao,et al.  A novel scheme of ROI detection and transcoding for mobile devices in high-definition videoconferencing , 2013, MoVid '13.

[40]  Wenjun Wu,et al.  A Real-time Personalized Gesture Interaction System Using Wii Remote and Kinect for Tiled-Display Environment , 2013, SEKE.