In order to resolve the service quality problems of a video conference system in the IP network environment, on the basis of analyzing the video conference's structure and achievement characteristics, we propose the overall framework of the NCCS(network communication control subsystem) in the video conference system. We study realization methods of the NCCS and discuss the specific implementation process of system's various component modules. Finally, we mainly research high-performance concurrent security of network server and integration of multiple media data stream in the NCCS, in addition, we provide an effective solution to streaming media handling method for implementing video conference.