Human Machine Interface for controlling a robot using image processing

Abstract This paper introduces a head movement based human machine interface (HMI) that uses the right and left movements of head to control a robot motion. An approach for making an effective technique for real-time face orientation information system, to control a robot which can be efficiently used for electrical powered wheelchair (EPW). The project aims at application related to HMI, the system (machine) identifies the orientation of the face movement with respect to the pixel values of image in a certain areas. The whole image is divided into three parts on the basis of x value of image (x, y). On the basis of orientation of face, maximum pixel value of approximate same range lie in one of divided parts. This information will be transferred to the microcontroller through serial communication port and control the motion of robot in real time by using head movements.

[1]  Dong-Soo Kwon,et al.  Human-friendly interfaces of wheelchair robotic system for handicapped persons , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Huosheng Hu,et al.  A multi-modal human machine interface for controlling an intelligent wheelchair using face movements , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[3]  Muhammad Ali Mazidi,et al.  The 8051 Microcontroller and Embedded Systems : Using Assembly and C , 1999 .