The current system of education is not as interactive as it can be. It lacks participatory learning from the student point of view. The future of learning is visual and interactive. Keeping this aspect in mind, the primary goal of our research work “Learning Math Using Gesture” is to interface 3D animation software and gesture recognition hardware to create an interactive learning environment. Blender an Open Source 3D animation tool provides a way for modeling and animation aspects. Another important ingredient is Microsoft Kinect that provides a way for capturing real time gestures of users. In this paper we present a method for manipulating Blender models using Kinect. This Human-Computer Interaction method can be used to make various learning tools to make teaching more visual, animated and lively rather than mere reading from the book.