To address the problem of anchor speakers tracking in broadcast news, an algorithm that integrated effectively speaker segmentation and clustering and speaker verification is presented. An anchor speakers tracking system based on the proposed algorithm is also designed. The system firstly uses audio activity detection algorithm in order to remove silence segments. Secondly, a speaker segmentation and clustering process converts multi-speaker speech waveform into several speaker homogenous segments. Finally, speaker verification approach based on GMM-UBM is dedicated to decide whether a segment belongs to one targeted anchor speaker. Furthermore, the impact of T-norm on system performance is also analyzed. Experiments on CCTV Mandarin Broadcast News demonstrate the effectiveness of the proposed algorithm. The tracking system achieves precision and recall at 93.03% and 84.34% respectively.