Motion Sensing Technology makes people interact with computer more directly and reduces the constraints of mouse and keyboard. This paper studies the key technology of Motion Sensing Technology and Kalman filtering algorithm deeply. At the same time it presents a gesture recognization algorithm based on skeleton coordinates. At last this paper expounds the design and implementation of Gesture Tracking and Recognization System based on Kinect.