With the rapid development of the content-based image retrieval technology, automatic semantic annotation has become the challenging task in this field. A wide variety of methods have been proposed during the past decades. The classficiation, key technology, problems and the further study of semantic annotation were discussed in detail in the paper. It is valuable for the researchers who devote to the research in this field.