Shot boundary detection (SBD) is an important and fundamental step in video content analysis such as content-based video indexing, browsing, and retrieval. In this paper, we present a hybrid SBD method by integrating a technique of high-level fuzzy Petri net (HLFPN) and keypoint matching. The HLFPN with histogram difference is executed as a pre-detection. Next, the speeded up robust features (SURF) algorithm that is reliably robust to image affine transformation and illumination variation is used to figure out the possible false shots and gradual transition based on the assumption from HLFPN. The top-down design can effectively lower down the computational complexity of SURF algorithm. The proposed algorithm has increased the precision of SBD and can be applied to different types of videos.