Isomerous data fusion based coordinated gesture recognition method and system of sensor

The invention discloses an isomerous data fusion based coordinated gesture recognition method and a system of a sensor. The method comprises the steps of 1, training a gesture motion recognition model based on isomerous data collected by a camera and a sensor; 2, constructing a threshold model by the gesture motion recognition model; and 3, segmentally recognizing input continuous motion sequences based on the gesture motion recognition model and the threshold model. The method and the system overcome the problem that commonly, vision based technology is of strong dependency on surrounding environment and position, and insensitive to overturn. Meanwhile, the method and the system solve the problem that the gesture recognition precision and efficiency are not high in sensor based gesture recognition and erroneous judgment and lost judgment occur. The invention provides the gesture recognition method which is high in recognition accuracy, strong in robustness and reliable in recognition of gesture motion and the system thereof.