Deep Learning-Enabled Real Time In-Site Quality Inspection Based On Gesture Classification

In this paper we present a novel method for performing in site real time quality inspection (QI) and consequently, digitalization of manual processes performed by human workers. It complements and improves our previous work in this area, which makes use of telemetry gathered from a smartwatch to classify manual actions as successful or unsuccessful. This new methodology provides the worker with a real time capable, robust and more accurate quality inspector. This work enhances the existing system through the elimination of input from the user by making use of a BIOX bracelet that detects gestures. The signal processing and classification methods are simplified and optimised by using assembled neural networks thus merging together the data gathered from multiple signal sources. Consequently, the overall QI system is improved with around 70%, thus furthering the necessary development needed to have a system ready to be used on a production environment.