The retrieval technique based on shape feature is one of the hotspots in image retrieval research. This paper puts forward a retrieval method based on image shape and direction energy. This method has two steps: first, do some basic treatments of the image, including denoising, procuring and thinning the edges and adjusting the angles; second, according to the energy accumulation of the eight directions of the image, make unitary processing to get cumulative energy data. In the end, this paper briefly states the design of the image intelligent retrieval system, and through the application of this system offers some image retrieval effects based on direction energy retrieval.