The paper introduces the hardware structure and working process of the embedded microprocessor based on S3C2440 streaming media system. The server will be streaming media data transmitted by RTP/RTCP protocol. The client will decompress and playback of received data real-time. The receive buffer is allocated into the receive buffer, playout buffer and DMA buffer. The sizes of the three buffers are arranged according to the ratio of 1:1:2. To constrain the buffer zone by the average rate, delay jitter and decoding rate and other parameters of thecapacity. In the receiving buffer, two critical points are set. Through the detection of the two critical points, we can assist the data sending rate adjustment of the sending end. Not only can avoid network congestion, but also can improve the quality of streaming media transmission.