The accuracy of the hand feature points location directly affects the correctness of the hand matching. On the basis of the existing hand features location, this paper proposes a feature points location algorithm, which is based on partial blocks scanning. The algorithm starts from the middle finger peak which is the most easy to locate. Then we determine the coordinates of the rest fingers peak points and valley points, step by step according to a fixed order recursive formula block based on the coordinate of the middle finger peak. Then, we extract the hand feature vectors based on the determined feature point and use matching algorithm based on the hand feature vectors to match. Experimental results show that the success rate of the algorithm's feature points is up to 93% and the accuracy rate of the hand shape recognition is up to 80.5%. This indicates that the algorithm can accurately locate the hand feature points and the algorithm is feasible.