This paper designed a wireless video monitoring system based on ARM and DSP dual-core structure according to the application requirements of video monitoring equipment. The system adopted CMOS camera to acquire image, which was compressed in DM642 with JPEG2000, read by S3C2410 through the HPI port of DSP, and then transmitted to the server through 3G network. The hardware and software structure and design thought were both illustrated in detail.