Robot navigation control using vision based steering wheel

Human-robot interaction has recently drawn great attention in both academic and industrial communities. Given the benefit features of human-robot interaction, this article developed a robot navigation control system with graphic user interface using user’s hand positions and hand gesture recognition. A new skin color fusion of channels among several color spaces, such as RGB-H-Cr-Cb, is proposed in this research. Human face properties are taken as a reference to detect and segment the hand regions. The hand recognition module uses the Weber local descriptor cooperated with the support vector machine. In experimental results, the skin segmentation as well as hand recognition method is compared with some previous methods to demonstrate the proposed methods’ flexibility and robustness to be implemented in real-time applications.

[1]  N. A. Abdul Rahim,et al.  RGB-H-CbCr skin colour model for human face detection , 2006 .

[2]  Amal Punchihewa,et al.  Voice command interpretation for robot control , 2011, The 5th International Conference on Automation, Robotics and Applications.

[3]  Yanmin Zhu,et al.  Real-time hand gesture recognition with Kinect for playing racing video games , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[4]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[5]  Wu-Chih Hu,et al.  Vision-Based Hand Gesture Recognition Using PCA+Gabor Filters and SVM , 2009, 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[6]  Adrian Kaehler,et al.  Learning opencv, 1st edition , 2008 .

[7]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[8]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[9]  Luis Issolio,et al.  Brightness for different surround conditions: The effect of transient glare , 2006, Perception & psychophysics.

[10]  Muhammad Ghulam,et al.  Race recognition using local descriptors , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Hiranmoy Roy,et al.  Human Face Detection in Color Images Using HSV Color Histogram and WLD , 2014, 2014 International Conference on Computational Intelligence and Communication Networks.

[12]  Christopher Assad,et al.  Gesture-based robot control with variable autonomy from the JPL BioSleeve , 2013, 2013 IEEE International Conference on Robotics and Automation.

[13]  Chen Guolong,et al.  The Research of Face Recognition Based on PCA and K-Nearest Neighbor , 2012, 2012 Symposium on Photonics and Optoelectronics.

[14]  Yen-Ting Chen,et al.  Multiple-angle Hand Gesture Recognition by Fusing SVM Classifiers , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[15]  Tao Zhang,et al.  Real-time Vision-based Gesture Recognition for Human Robot Interaction , 2004, 2004 IEEE International Conference on Robotics and Biomimetics.

[16]  Sven Behnke,et al.  The humanoid museum tour guide Robotinho , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[17]  Yoichiro Maeda,et al.  Development of body mapping from human demonstrator to inverted-pendulum mobile robot for imitation , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[18]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[19]  Jagdish Lal Raheja,et al.  Real-Time Robotic Hand Control Using Hand Gestures , 2010, 2010 Second International Conference on Machine Learning and Computing.

[20]  Gabriel Pérez,et al.  Explicit image detection using YCbCr space color model as skin detection , 2011 .

[21]  Anwar M. Mirza,et al.  Gender recognition from face images with local WLD descriptor , 2012, 2012 19th International Conference on Systems, Signals and Image Processing (IWSSIP).

[22]  Javier Ruiz-del-Solar,et al.  Skin detection using neighborhood information , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[23]  Jasmin Christian Blanchette,et al.  C++ GUI programming with Qt 4 , 2004 .

[24]  Fakhri Karray,et al.  A testbed platform for assessing human-robot verbal interaction , 2010, 2010 International Conference on Autonomous and Intelligent Systems, AIS 2010.

[25]  R. C. Luo,et al.  Human-robot interaction with multi-sensor fusion based hand sign recognition for service robot , 2012, IECON 2012 - 38th Annual Conference on IEEE Industrial Electronics Society.

[26]  Shutao Li,et al.  Face recognition using the Weber Local Descriptor , 2011, The First Asian Conference on Pattern Recognition.

[27]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[28]  Manish Kumar,et al.  Face Recognition Using Principle Component Analysis, Eigenface and Neural Network , 2010, 2010 International Conference on Signal Acquisition and Processing.