Four Sensors Bracelet for American Sign Language Recognition based on Wrist Force Myography

Recently, Force myography (FMG) has emerged as an alternate method for gesture recognition applications. It is usually used as raw signal, in combination with data acquired from other sensors or with a large number of sensors for an efficient recognition performances. Only four FMG commercial sensors constitute the proposed gesture recognition system. They are connected as an FSR sensor’s bracelet applied for american sign language(ASL) recognition. In this paper, a comparative study between raw FMG and six commonly extracted features when implemented on the Extreme Learning Machine (ELM) to assess the accuracy of nine ALS alphabet recognition system. 16 trials of the nine gestures were collected from a healthy male wearing the FMG bracelet. In addition, 5 folds cross validation was implemented during the ELM training. As results it was noted that the accuracy based on six commonly features was equal to 89.65%, which over perform not only the raw FMG based gesture recognition that reached only a testing total accuracy of 68.96% by our 4 sensors but also some 8 sensor’s raw data systems in literature.

[1]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[2]  L. Ladha,et al.  FEATURE SELECTION METHODS AND ALGORITHMS , 2011 .

[3]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[4]  Claudio Castellini,et al.  A Comparative Analysis of Three Non-Invasive Human-Machine Interfaces for the Disabled , 2014, Front. Neurorobot..

[5]  Carlo Menon,et al.  Virtual grasps recognition using fusion of Leap Motion and force myography , 2018, Virtual Reality.

[6]  Yimesker Yihun,et al.  Performance of Forearm FMG for Estimating Hand Gestures and Prosthetic Hand Control , 2019, Journal of Bionic Engineering.

[7]  Olfa Kanoun,et al.  Muscle Movement Tracking Using Nanocomposite Based Pressure Sensor , 2019, 2019 16th International Multi-Conference on Systems, Signals & Devices (SSD).

[8]  Gautam P. Sadarangani,et al.  Force Myography for Monitoring Grasping in Individuals with Stroke with Mild to Moderate Upper-Extremity Impairments: A Preliminary Investigation in a Controlled Environment , 2017, Front. Bioeng. Biotechnol..

[9]  Mehrdad Saif,et al.  Hand gesture recognition using force myography of the forearm activities and optimized features , 2018, 2018 IEEE International Conference on Industrial Technology (ICIT).

[10]  Olfa Kanoun,et al.  Wrist Force Myography (FMG) Exploitation for Finger Signs Distinguishing , 2019, 2019 5th International Conference on Nanotechnology for Instrumentation and Measurement (NanofIM).

[11]  Carlo Menon,et al.  Exploration of Force Myography and surface Electromyography in hand gesture classification. , 2017, Medical engineering & physics.

[12]  Carlo Menon,et al.  Force Myography to Control Robotic Upper Extremity Prostheses: A Feasibility Study , 2016, Front. Bioeng. Biotechnol..