In this research, we develop the stereo visual odometry based on the algorithm of the stepwise bundle adjustment, with mobile stereo camera system which is made by ourselves. Coplanar condition and Collinear condition, which are the concepts of the Photogrammetry, are utilized to eliminate the error matches after image matching. To improve the feature points, the concept of circular matching is added into the algorithm, which means keeping the feature points that is caught by all adjacent image pairs. The last step is using the stepwise bundle adjustment to solve the relative motion of adjacent image pairs, and we can rebuild the whole trajectory of the mobile stereo system with combining all the results. There are indoor scenario and outdoor scenario in the experiment of this research. Indoor scenario is the ground floor of department of Geomatics of NCKU; outdoor scenario is the square in front of museum of NCKU. The results show that the drift ratio of the two scenario are smaller than 1% and 1.6% respectively.