In the chorus music teaching of primary and middle schools, the rhythm training is very important. Rhythm not only plays the role of skeleton and soul in music, but also has some typical meaning and leading role in music, therefore, one of the indispensable links in the regular chorus teaching is to grasp the accurate rhythm through the rhythm training, through the effective rhythm training is conducive to cultivating students' musical sentiment and better interpretation of the artistic conception of the music works in the process of singing. Therefore, according to the students'ability to comprehend music and their learning characteristics, and combined with the actual situation, this paper explores how to carry out the rhythm training in the chorus music teaching process in primary and secondary schools.