To realize the video transmission in a remote monitoring system, a new video transmission solution was designed. The JRTPLIB and H.264 video structure were analyzed in detail, and the video packet method was also discussed in depth. Finally, to overcome the disadvantages brought by unstability and congestion of network, a new method for flow control was put forward. The test results show the system works well with the feature of real-time, good stability and low packet loss.