In view of the fact that the building area under construction has features that are different from the features of the surrounding non-construction buildings and different from the surrounding natural environment texture features, a construction area recognition method based on the color and texture features of the building under construction is proposed. Firstly, color and texture features are extracted from images that only contain the image data of the building under construction. The image feature index database is constructed from these feature vectors. Then, the image to be detected is divided into blocks, and the color vegetation is masked to the green vegetation area and the feature vector is calculated. It is measured by the similarity with the feature index database, to determine the position of the image block in the entire detected image, and to select the red rectangle and the unique identifier box for the detected building under construction. The experimental results show that the proposed method for recognizing the building area under construction can effectively identify the building area under construction in urban images from high altitude. The system based on this algorithm can be applied to urban planning.