Decreasing of water content in harvested litchi fruits causes weight loss, color changes and low quality. Therefore, how to keep lower loss of water content in litchi fruits becomes a crucial problem. The major goal of this study was to determine the quality changes of litchi fruits with color changes by using image processing. Color changes in litchi fruits were evaluated with the noninvasive technique under fixed temperature. Quantitative parameters of every litchi fruit such as average gray scale of RGB, HSI, area and perimeter could be measured by using color space transform, morphological smoothing and contour tracing. Sixty litchi fruits without keeping fresh processing were tested during four days. Experimental results indicated the average hue value and weight changes were most correlated among HSI color model.