Hand detection in First Person Vision

The emergence of new pervasive wearable technologies (e.g. action cameras and smart glasses) calls attention to the so called First Person Vision (FPV). In the future, more and more everyday-life videos will be shot from a first-person point of view, overturning the classical fixed-camera understanding of Vision, specializing the existing knowledge of moving cameras and bringing new challenges in the field of video processing. The trend in research is going to be oriented towards a new type of computer vision, centred on moving sensors and driven by the need for new applications for wearable devices. We identify hand tracking and gesture recognition as an essential topic in this field, motivated by the simple realization that we often look at our hand, even while performing the simplest tasks in everyday life. In addition, the next frontier in user interfaces are hands-free devices. In this work we argue that applications based on FPV may involve information fusion at various complexity and abstraction levels, ranging from pure image processing to inference over patterns. We address the lowest, by proposing a first investigation on hand detection from a first-person point of view sensor and some preliminary results obtained fusing colour and optic flow information.

[1]  P. Anderson,et al.  Through the Glass Lightly , 1995, Science.

[2]  Gian Luca Foresti,et al.  Multisensor data fusion for autonomous vehicle navigation in risky environments , 2002, IEEE Trans. Veh. Technol..

[3]  P. Varshney,et al.  Multisensor surveillance systems : the fusion perspective , 2003 .

[4]  Yingchun Ding,et al.  An extended HOG model: SCHOG for human hand detection , 2012, 2012 International Conference on Systems and Informatics (ICSAI2012).

[5]  Rini Akmeliawati,et al.  A hybrid method using haar-like and skin-color algorithm for hand posture detection, recognition and tracking , 2010, 2010 IEEE International Conference on Mechatronics and Automation.

[6]  Carlo S. Regazzoni,et al.  Bayesian Tracking for Video Analytics , 2010, IEEE Signal Processing Magazine.

[7]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[8]  Yue Cao,et al.  Research on a Skin Color Detection Algorithm Based on Self-adaptive Skin Color Model , 2010, 2010 International Conference on Communications and Intelligence Information Security.

[9]  Tom Froese,et al.  Using Human–Computer Interfaces to Investigate ‘Mind-As-It-Could-Be’ from the First-Person Perspective , 2012, Cognitive Computation.

[10]  Jing Pan,et al.  Hand Detection Using Robust Color Correction and Gaussian Mixture Model , 2011, 2011 Sixth International Conference on Image and Graphics.

[11]  Rod Furlan Build your own google glass [Resources_Hands On] , 2013, IEEE Spectrum.

[12]  Jinwei Jiang,et al.  Good features to track: A view geometric approach , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[13]  Carlo S. Regazzoni,et al.  Early fire and smoke detection based on colour features and motion analysis , 2012, 2012 19th IEEE International Conference on Image Processing.

[14]  Takahiro Okabe,et al.  Fast unsupervised ego-action learning for first-person sports videos , 2011, CVPR 2011.

[15]  Carlo S. Regazzoni,et al.  Automatic detection of dangerous events for underground surveillance , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[16]  Sukeshni N. Tamgade,et al.  Motion Vector Estimation of Video Image by Pyramidal Implementation of Lucas Kanade Optical Flow , 2009, 2009 Second International Conference on Emerging Trends in Engineering & Technology.

[17]  Ashwin P. Dani,et al.  Structure and motion estimation of a moving object using a moving camera , 2010, Proceedings of the 2010 American Control Conference.

[18]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[19]  Elise Ackerman Google gets in your face [2013 Tech To Watch] , 2013, IEEE Spectrum.

[20]  Shanq-Jang Ruan,et al.  Honeycomb Model Based Skin Color Detector for Face Detection , 2008, 2008 15th International Conference on Mechatronics and Machine Vision in Practice.

[21]  Alessio Del Bue,et al.  Smart cameras with real-time video object generation , 2002, Proceedings. International Conference on Image Processing.

[22]  Karyn Hede News Briefs , 2013, Genetics in Medicine.

[23]  S. Mann Through the Glass, Lightly [Viewpoint] , 2012, IEEE Technol. Soc. Mag..

[24]  Franco Oberti,et al.  Change detection methods for automatic scene analysis by using mobile surveillance cameras , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[25]  Carlo S. Regazzoni,et al.  A multi-sensor cognitive approach for active security monitoring of abnormal overcrowding situations , 2012, 2012 15th International Conference on Information Fusion.

[26]  Michael I. Mandel,et al.  Visual Hand Tracking Using Nonparametric Belief Propagation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[27]  N. M. Tahir,et al.  Hand detection from silhouette for video surveillance application , 2012, 2012 IEEE 8th International Colloquium on Signal Processing and its Applications.

[28]  I. Bloch,et al.  Data fusion in 2D and 3D image processing: an overview , 1997, Proceedings X Brazilian Symposium on Computer Graphics and Image Processing.

[29]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Stan Sclaroff,et al.  Automatic 2D Hand Tracking in Video Sequences , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[31]  Carlo S. Regazzoni,et al.  Self-organizing shape description for tracking and classifying multiple interacting objects , 2006, Image Vis. Comput..

[32]  Alex Pentland,et al.  InSense: Interest-Based Life Logging , 2006, IEEE MultiMedia.

[33]  Lei Yang,et al.  Hands Detection Based on Statistical Learning , 2012, 2012 Fifth International Symposium on Computational Intelligence and Design.