We take advantage of the uncorrelated lαβcolor space to accomplish colorization of grayscale images. Even though the problem of adding chromatic values to a grayscale image has no exact solution, our approach attempts to provide a method to minimize the amount of human labor required for this task. Instead of choosing RGB colors from a palette to color individual components, we propose a segmentation-based color transferring method to deliver entire color mood to target images by matching luminance and texture information between the images. With a novel time-saving image segmentation procedure and an effective color-matching method for grayscale images, we get substantially speed-up and make it possible to be used in video processing applications.