In this paper, we propose a simple non-linear image filter based on the median filter structure. The proposed algorithm achieves the effective noise-removal for color image with impulse noises, and reduces the discoloration problem of the traditional filter. The major advantages of the novel method include: (1) it takes less calculations than the vector filter in the color image process, so the proposed method is more suitable for using in several low-cost and real-time applications. (2) It can deal with the tradeoff problem between image smoothing and edge correction caused in the filtering process. The experimental results show that our method performs better effect than traditional filter and significantly reduces the damages of image edge in the procedure of removing the impulse noise.