In order to improve efficiency and to reduce cost of fast prototype manufacturing for precision parts, a prototype manufacturing system which can rapidly punch sheet metals to produce various workpieces is proposed. The proposed system includes a punching module, a materials carrier and a tool turret. In this paper, the clamping mechanism of the punching module is optimized to improve the clamping precision, the quality of the prototype, as well as the punch and die life. The experiment result shows that the precision of the prototype is within the range of ±0.03 mm by using the proposed system to stamp the prototype of lead frame.