Edge detection algorithm is the most common image processing algorithms. The principles of two kinds of edge detection algorithm-Prewitt operator and Sobel operator are analyzed. The DSP design of the image edge detection algorithm is completed by using DSP Builder tool in a friendly environment MATLAB/Simulink. And then the design is implemented directly in FPGA. It can shorten the image processing time with the capability of parallel process by using FPGA to process image.