A Real-Time Face Motion Based Approach towards Modeling Socially Assistive Wireless Robot Control with Voice Recognition

The robotics domain has a couple of specific general design requirements which requires the close integration of planning, sensing, control and modeling and for sure the robot must take into account the interactions between itself, its task and its environment surrounding it. Thus considering the fundamental configurations, the main motive is to design a system with user-friendly interfaces that possess the ability to control embedded robotic systems by natural means. While earlier works have focused primarily on issues such as manipulation and navigation only, this proposal presents a conceptual and intuitive approach towards man-machine interaction in order to provide a secured live biometric logical authorization to the user access, while making an intelligent interaction with the control station to navigate advanced gesture controlled wireless Robotic prototypes or mobile surveillance systems along desired directions through required displacements. The intuitions are based on tracking real-time 3-Dimensional Face Motions using skin tone segmentation and maximum area considerations of segmented face-like blobs, Or directing the system with voice commands using real-time speech recognition. The system implementation requires designing a user interface to communicate between the Control station and prototypes wirelessly, either by accessing the internet over an encrypted Wi-Fi Protected Access (WPA) via a HTML web page for communicating with face motions or with the help of natural voice commands like “Trace 5 squares”, “Trace 10 triangles”, “Move 10 meters”, etc. evaluated on an iRobot Create over Bluetooth connectivity using a Bluetooth Access Module (BAM). Such an implementation can prove to be highly effective for designing systems of elderly aid and maneuvering the physically challenged.

[1]  Francesco Camastra,et al.  Real-Time Hand Gesture Recognition Using a Color Glove , 2011, ICIAP.

[2]  Alexandre L. M. Levada,et al.  Voice Command Recognition with Dynamic Time Warping (DTW) using Graphics Processing Units (GPU) with Compute Unified Device Architecture (CUDA) , 2007 .

[3]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[4]  Mrinal K. Mandal,et al.  Efficient face and gesture recognition techniques for robot control , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[5]  Partha Das,et al.  A Novel approach for Graphical User Interface development and real time Object and Face Tracking using Image Processing and Computer Vision Techniques implemented in MATLAB , 2013 .

[6]  Dong Yu,et al.  Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[7]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Chellu Chandra Sekhar,et al.  HMM Based Intermediate Matching Kernel for Classification of Sequential Patterns of Speech Using Support Vector Machines , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[9]  Kong-Pang Pun,et al.  A finger-tracking virtual mouse realized in an embedded system , 2005, 2005 International Symposium on Intelligent Signal Processing and Communication Systems.

[10]  Debasish Kundu,et al.  A novel approach towards detecting faces and gender using skin segmentation and template matching , 2015, 2015 2nd International Conference on Signal Processing and Integrated Networks (SPIN).

[11]  Abhinaba Bhattacharjee,et al.  A novel probabilistic approach of colored object detection and design of a gesture based real-time mouse tracking along with virtual teaching intended for color-blind people , 2015, 2015 2nd International Conference on Signal Processing and Integrated Networks (SPIN).

[12]  N. Sahu.  EDGE BASED HUMAN FACE DETECTION USING MATLAB , 2014 .

[13]  Georgios Tziritas,et al.  Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis , 1999, IEEE Trans. Multim..

[14]  José Mario García Valdez,et al.  Accelerometer-Based Hand Gesture Recognition Using Artificial Neural Networks , 2011, Soft Computing for Intelligent Control and Mobile Robotics.