The optimization of the moving target detection in complex environment which based on the Soldiers Shooting Confrontation System is proposed in this article. The algorithmis discussed from two aspects, the efficiency and the accuracy effected by the interference. To improve the efficiency of the algorithm, the large images from the video stream are first down-scaled,so that the location of the moving targets can be quickly determined.After that,the targets will be accurately analyzed in the original images according to their positions. In addition, the effect of the camera shaking and light changing can be eliminated by blending the current image with the background. Combining with background subtraction, background update can effectively improve the accuracy of the algorithm.