An Accelerometer-Based Digital Pen With a Trajectory Recognition Algorithm for Handwritten Digit and Gesture Recognition

This paper presents an accelerometer-based digital pen for handwritten digit and gesture trajectory recognition applications. The digital pen consists of a triaxial accelerometer, a microcontroller, and an RF wireless transmission module for sensing and collecting accelerations of handwriting and gesture trajectories. The proposed trajectory recognition algorithm composes of the procedures of acceleration acquisition, signal preprocessing, feature generation, feature selection, and feature extraction. The algorithm is capable of translating time-series acceleration signals into important feature vectors. Users can use the pen to write digits or make hand gestures, and the accelerations of hand motions measured by the accelerometer are wirelessly transmitted to a computer for online trajectory recognition. The algorithm first extracts the time- and frequency-domain features from the acceleration signals and, then, further identifies the most important features by a hybrid method: kernel-based class separability for selecting significant features and linear discriminant analysis for reducing the dimension of features. The reduced features are sent to a trained probabilistic neural network for recognition. Our experimental results have successfully validated the effectiveness of the trajectory recognition algorithm for handwritten digit and gesture recognition using the proposed digital pen.

[1]  Zhuxin Dong,et al.  An Optical-Tracking Calibration Method for MEMS-Based Digital Writing Instrument , 2010, IEEE Sensors Journal.

[2]  Chi Chiu Tsang,et al.  An Attitude Compensation Technique for a MEMS Motion Sensor Based Digital Writing Instrument , 2006, 2006 1st IEEE International Conference on Nano/Micro Engineered and Molecular Systems.

[3]  David Howard,et al.  A Comparison of Feature Extraction Methods for the Classification of Dynamic Activities From Accelerometer Data , 2009, IEEE Transactions on Biomedical Engineering.

[4]  Adrian David Cheok,et al.  Combined Wireless Hardware and Real-Time Computer Vision Interface for Tangible Mixed Reality , 2007, IEEE Transactions on Industrial Electronics.

[5]  Donald F. Specht,et al.  Probabilistic neural networks and general regression neural networks , 1996 .

[6]  Lei Wang,et al.  Feature Selection with Kernel Class Separability , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Jing Yang,et al.  Magic wand: a hand-drawn gesture input device in 3-D space with inertial sensors , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[8]  Young Soo Suh,et al.  Attitude Estimation by Multiple-Mode Kalman Filters , 2006, IEEE Transactions on Industrial Electronics.

[9]  Soo-Young Lee,et al.  On-Line Handwritten Character Recognition with 3D Accelerometer , 2006, 2006 IEEE International Conference on Information Acquisition.

[10]  Farid Golnaraghi,et al.  A Kalman/Particle Filter-Based Position and Orientation Estimation Method Using a Position Sensor/Inertial Measurement Unit Hybrid System , 2010, IEEE Transactions on Industrial Electronics.

[11]  Farid Golnaraghi,et al.  A Fastening Tool Tracking System Using an IMU and a Position Sensor With Kalman Filters and a Fuzzy Expert System , 2009, IEEE Transactions on Industrial Electronics.

[12]  Jing Yang,et al.  Inertial sensor based recognition of 3-D character gestures with an ensemble classifiers , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[13]  Chi Chiu Tsang,et al.  A Calibration Method for MEMS Inertial Sensors Based on Optical Tracking , 2007, 2007 2nd IEEE International Conference on Nano/Micro Engineered and Molecular Systems.

[14]  Yoon Sang Kim,et al.  A new wearable input device: SCURRY , 2005, IEEE Transactions on Industrial Electronics.

[15]  Shengli Zhou,et al.  Hand-written character recognition using MEMS motion sensing technology , 2008, 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[16]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[17]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Jing Yang,et al.  Analysis and compensation of errors in the input device based on inertial sensors , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[19]  Sethuraman Panchanathan,et al.  Recognition of hand movements using wearable accelerometers , 2009, J. Ambient Intell. Smart Environ..

[20]  Jong Gwan Lim,et al.  Pattern recognition-based real-time end point detection specialized for accelerometer signal , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[21]  Fumio Harashima,et al.  Natural Interface Using Pointing Behavior for Human–Robot Gestural Interaction , 2007, IEEE Transactions on Industrial Electronics.

[22]  Yen-Ping Chen,et al.  Online classifier construction algorithm for human activity detection using a tri-axial accelerometer , 2008, Appl. Math. Comput..

[23]  Yu-Liang Hsu,et al.  An Inertial-Measurement-Unit-Based Pen With a Trajectory Reconstruction Algorithm and Its Applications , 2010, IEEE Transactions on Industrial Electronics.