Real-time communication mainly transmits real-time audio and video with low latency and high bandwidth consumption. In the scenario of large number of users, the single server solution cannot meet the overall needs, so it is necessary to build a distributed cluster to provide services, and how to properly distribute these requests to different servers, balance the load of servers in the cluster is particularly important. This paper first analyzes the real-time communication flow of single server. Then the common load balancing algorithms are analyzed. In order to meet the consistency requirements of forwarding from the same group of clients to the same server, an adaptive load balancing algorithm based on consistency Hash algorithm and genetic algorithm is proposed and verified.