Intelligent video surveillance is a development trend of Industrial Automation. In order to monitor steel pipe production efficiently and independent, this paper proposes a new method to extract moving target. The new method considers the movement of product line as static background based on the theory of Relative Motion. With static background library, it can update background adaptively and extract moving target according to background difference. It is proved that the new method uses less resources and has high reliability