In moving object detection process, it needs to automatically judge whether it has detected the moving object, although there is no moving object in the current scene, detection result wrongly judges that it has detected the moving object. In order to find the source of the error, optical flow disturbance effect is found through experiment. The optical flow disturbance effect detection algorithm is designed, and the effect of optical flow perturbation is clearly detected. Next, through the binarization method of image it eliminates optical flow disturbance effect. The ideal results of the moving object detection are obtained. This research proves that the optical flow perturbation effect exists in the space, which can cause interference to the detection of moving object. It also can eliminate the effect of optical flow disturbance and improve the accuracy and reliability of moving object detection and judgment.