In order to solve the case of vehicle video background changes in real time vehicle detection and tracking issues, this article raises a rear axle feature-based vehicle identification and tracking algorithm. Its characteristic is using innovative rear axle feature. Axial characteristics are specific for the two in the rear brake light for the endpoint, license plate at the end line of the axis of symmetry. Algorithm will calculate its histogram information after obtaining the target area and particle filter tracking. Finally, we test the feasibility of algorithms.