In the existing depth estimation algorithm, when the depth estimation is performed on the image of the light field sequence, the matching effect is poor and the robustness is low when the image brightness changes and in the weak texture region. Aiming to solve these problems, this study proposes an adaptive weight block matching algorithm based on CIELab color space. Since the color difference matching in color image RGB color space has many influencing factors, the algorithm converts to CIELab space for color similarity matching to calculate the weight value, and then combines the gradient and distance to calculate the matching image and the matching block in the image to be matched to obtain the comprehensive weight value. Finally, according to the linear characteristics of the Epipolar Plane Image (EPI), the matching image and the image block to be matched in the image sequence are matched and calculated, and the depth map is obtained. After simulation, the proposed algorithm can estimate the depth information of the scene better, and the accuracy is greatly improved. It is obviously superior to the previous depth estimation algorithm and can be widely used.