There are two general issues for the multi view image. The first kind of issue is about mask effect. The main reason is due to the shooting angle from the different visual angles. The second kind of issue is about the different luminance. The main reason is that using a plurality of cameras for shooting causes the scene and luminance of light influenced so that each of view has different degree of light and causes obviously different degree of luminance for the users. In order to improve the above issues, this paper proposes a luminance correction algorithm. However, after the luminance correction algorithm processes, the color information is influenced. In order to adjust the color information corresponding with the luminance change, this paper provides a color correction method. The method can improve the multi view image to have the better performance. In the experiment, the result shows that the multi view image has a better performance after using the luminance correction algorithm and the color correction method.