This paper describes the data glove used for gesture recognition, and proposes an improved neural network algorithm for gesture recognition based on data glove. The neural network is used to achieve clustering, which is not only intuitive as the cluster analysis, but also has the ability to learn from the data as the neural network. Experimental results show that the new algorithm significantly improved the intelligence level of gesture recognition.