The integration of tone, data and other new services has speeded Chinamobile's step to implement entire network business operation & support system (BOSS). However, the traditional evaluation system only focus on certain region and a few performance characteristics, and customer's feeling is ignored in quality evaluation. To deal with it, analytic hierarchy process (AHP) is proposed to do health degree evaluation for the China Mobile's entire network business operation & support system. Specific evaluation indexes are set up firstly for evaluating health degree of BOSS. Further, the factor set, evaluation set and the set of weights are created for comprehensive evaluation of the business operation quality. The experiment shows that AHP based method can provide hierarchal quantitative and qualitative analysis. Its strong operability and good performance predicts a good future for AHP to be widely used in quality evaluation for any BOSS.