Precise steel ball is an important application to stainless steel bearings manufacture in the precision industry. A steel ball of high quality determines the long lifespan of the machine. Therefore, the surface of the steel ball needs detecting precisely to ensure the high quality. There are many kinds of steel ball surface defects, including dent, scratch, rust and rupture by metal fatigue. The purpose of this study is to inspect and analyze the steel ball surface defects with the application of computer vision. Steel ball, which is a sphere, has many 2-axis flats. During the inspection, a lot of images of 2-axis flats are captured by cameras. After that, a customized circuit system, including a switch device and an emergency button, is designed with the use of image process technology which enhances images for differentiation of defects. In addition, automatic steel ball arrangement system and automatic steel ball differentiation system are also used to achieve the integration of the automatic systems for inspection of precise steel ball surface defects.