In order to solve the problem of security of video information, a chaotic video encryption algorithm based on H.264/AVC video coding standard is proposed. Because Stream cipher is simple, fast, etc., The proposed scheme uses discrete chaotic sequence of Logistic to encrypt the stream of CAVLC (Context-based Adaptive Variable Length Coding) entropy coding stage of H.264/AVC, and analyses the security and encryption efficiency of the algorithm. The results showed that the video encryption algorithm ensures the security of information, does not change the structure of the stream and the system has a good real-time and fast speed.