Because microservice fine-grained service splitting and decentralized architecture design is more suitable for current Internet agile development and rapid iteration than traditional SOA architecture, but traditional microservice service governance technology is difficult to realize the interconnection between services of different technical frameworks, and communication protocols, and there is a problem of high coupling between service governance and services. Based on the service mesh idea, this study implements a network proxy with service registration discovery, load balancing and protocol conversion as a service governance independent component of the microservice architecture, and maximize network proxy performance through Netty's framework, protobuf serialization, ETCD registry, and weighted polling load balancing algorithms. The experimental results show that the design of this study overcomes the problems of traditional microservice, and the network proxy has high availability, high concurrency, and high throughput performance.