Applications of video surveillance systems are commonly seen at present. These systems are commonly based on a fixed camera that yields static background and a narrow angle-of-view, therefore are subject to surveillance limitations. This thesis proposed a system in an attempt to detect moving objects with dynamic background in digital videos, using a moving camera which may pan left or right. This system adopts the methods including: feature point detection, pyramid optical flows, K-means clustering, etc. Our results demonstrate that our system is able to detect moving rigid objects as well as non-rigid objects, given the situation if the moving object with dynamic background doesn’t occupy over 50% of the image area. The overall detection rate has achieved over 90%. In summary, our system is able to increase the angle-of-view, thus reducing the surveillance limitations (blind spot).