In the research of computer vision, multiple object tracking is a very common issue. Most of relative techniques and research are referenced in recent years, but the majority of tracking images is projective camera image. Consequently, there is a few tracking techniques with fisheye image. Fisheye image has advantage in covering wide ground than other camera. Projective camera takes an image that is blocked by people when two people are too closed. Topped fisheye camera has a better information view than projective camera. In this paper, we refer to a new tracking method with topped fisheye camera image. In hope that we can detect and track people in real-time. We use 3-D voxels for tracking people. The position that we find a maximum probability in last frame serve as new position. For the higher accuracy, we use appearance feature to assist our tracking system, like color histogram.