This paper proposes a novel face detection and eye localization algorithm based on near-infrared (NIR) image. Initially. The AdaBoost algorithm is introduced here to detect face, and then detection of the presence of glasses is performed in the candidate face area. If glasses are not present in face area, N-Quoit filter will be used to locate eyes. Otherwise, eye location can be determined by the “Faceness” criterion. Experimental results demonstrate that our method is capable of achieving high accuracy and real-time performance, and is an effective solution to the issue of specular reflections of NIR lights on glasses in eye localization.