In the process of moving target detection, the traditional algorithm is based on modeling a single feature background, and the background description is not accurate enough. To solve this problem, this study proposes an algorithm based on Vibe background modeling that incorporates color and edge features. The proposed algorithm solves the problem of noise, breakpoints, and internal pores in the moving target detection result of the three-frame difference algorithm, and compensates the image processing results based on the morphological processing algorithm. In order to ensure the accuracy of moving target detection and speed up the elimination of the "ghosting" phenomenon in the first frame of Vibe algorithm, this study combines Vibe algorithm and improved three-frame difference algorithm to realize real-time detection of moving targets. Through research analysis and computational derivation, the detection results of moving targets in the experiment show that the improved three-frame difference algorithm based on Vibe background modeling is better than the three-frame difference algorithm.