In this paper, we proposed a kernelized k-means algorithm based on the Gaussian kernel function according to the concepts of support vector clustering and kernel methods. A statistical point of view of robust properties of the proposed method is analyzed. The cluster center estimates obtained by the proposed method can be represented by an M-estimate with a bounded function. This provides the theoretical advance to support the robustness of our clustering method. Numerical examples also show the superiority of the proposed method.