Smart System with Artificial Intelligence for Sensory Gloves

This paper presents a new sensory system based on advanced algorithms and machine learning techniques that provides sensory gloves with the ability to ensure real-time connection of all connectors in the cabling of a cockpit module. Besides a microphone, the sensory glove also includes a gyroscope and three accelerometers that provide valuable information to allow the selection of the appropriate signal time windows recorded by the microphone of the glove. These signal time windows are subsequently analyzed by a convolutional neural network, which indicates whether the connection of the components has been made correctly or not. The development of the system, its implementation in a production industry environment and the results obtained are analyzed.

[1]  Wojciech Matusik,et al.  Learning the signatures of the human grasp using a scalable tactile glove , 2019, Nature.

[2]  Weiliang Xu,et al.  Toward Whole-Hand Kinesthetic Feedback: A Survey of Force Feedback Gloves , 2019, IEEE Transactions on Haptics.

[3]  Gordon Cheng,et al.  Tactile-based active object discrimination and target object search in an unknown workspace , 2018, Autonomous Robots.

[4]  H. Dehghan,et al.  Relationship between Lighting and Noise Levels and Productivity of the Occupants in Automotive Assembly Industry , 2013, Journal of environmental and public health.

[5]  Joo Chuan Yeo,et al.  Sensorized fabric glove as game controller for rehabilitation , 2020, 2020 IEEE Sensors.

[6]  Huicong Liu,et al.  Sensory-Glove-Based Human Machine Interface for Augmented Reality (AR) Applications , 2020, 2020 IEEE 33rd International Conference on Micro Electro Mechanical Systems (MEMS).

[7]  Nico M. Temme,et al.  Error functions, Dawson's and Fresnel integrals , 2010, NIST Handbook of Mathematical Functions.

[8]  Di Guo,et al.  A robotic hand-arm teleoperation system using human arm/hand with a novel data glove , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[9]  Leonardo Meli,et al.  GESTO: A Glove for Enhanced Sensing and Touching Based on Inertial and Magnetic Sensors for Hand Tracking and Cutaneous Feedback , 2017, IEEE Transactions on Human-Machine Systems.

[10]  Hideki Koike,et al.  Sensor Glove Implemented with Artificial Muscle Set for Hand Rehabilitation , 2020, AHs.

[11]  Giorgio De Pasquale,et al.  Wearable sensing systems for biomechanical parameters monitoring , 2019 .

[12]  Olga Sorkine-Hornung,et al.  Interactive hand pose estimation using a stretch-sensing soft glove , 2019, ACM Trans. Graph..

[13]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  Yutaka Arakawa,et al.  A Smart Glove to Track Fitness Exercises by Reading Hand Palm , 2019, J. Sensors.

[15]  Vincent Hayward,et al.  Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives , 2017, IEEE Transactions on Haptics.

[17]  Muhammad Modi bin Lakulu,et al.  A Review on Systems-Based Sensory Gloves for Sign Language Recognition State of the Art between 2007 and 2017 , 2018, Sensors.

[18]  P. M. Mendes,et al.  FBG Sensing Glove for Monitoring Hand Posture , 2011, IEEE Sensors Journal.

[19]  Christiana Varnava.  Tactile glove picks up shapes , 2019 .

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Oliver Kroemer,et al.  A Review of Tactile Information: Perception and Action Through Touch , 2020, IEEE Transactions on Robotics.

[22]  T. Engleder,et al.  Development of a smart fabric force-sensing glove for physiotherapeutic Applications , 2019, Current Directions in Biomedical Engineering.

[23]  Shih-Ching Yeh,et al.  A Wearable Hand Rehabilitation System With Soft Gloves , 2021, IEEE Transactions on Industrial Informatics.

[24]  Ellen Yi-Luen Do,et al.  Tactile Teacher: Sensing Finger Tapping in Piano Playing , 2015, Tangible and Embedded Interaction.