The purpose of this study is to identify speaker by vocal password recognition. Each password includes four Chinese characters. Once a examinee speaks a password, energy method was used to separate the characters in the password. The characteristic frequencies of each character were obtained by calculating its first, second and third moments of the amplitude spectrum. The characteristic frequencies were used to recognize speaker’s identities. The sampled data included data for training and testing. The training data set was used to obtain the threshold and scoring rule in recognition process. The testing data set was used to verify the accuracy of the recognition method. Three different Chinese phases were investigated. The identification rates for each phase were 90%, 88% and 90%. It is inferred that the proposed method for vocal password recognition is very feasible.