The theories of five sounds and six voices are formed in the Pre-Qin Period. These theories are not only the conclusion of musical practice then, but also has become a particular thought of temperament as it integrates with the thought of the times. Some scholars consider it farfetched that the thought of temperament be merged into the thoughts of Yin-Yang and the five elements. This paper analyzes the contents and features of the thought of temperament in Han Dynasty from Han's documentations and has found that the thought of temperament in Han Dynasty has something compatible with the theory of astronomy and calendar. Following the thinking that temperament has certain common grounds with the theory of calendar, plus the record of practicing Luli music measurements and calendar together in the Han Dynasty is found in history books, it is obvious that the thought of temperament is closely related with the theory of calendar. The fact that both theory and practice are realized as history books combine ”Luzhi” and ”Lizhi” to become ”Luli Zhi” indicates that there is a trace of thought to follow instead of concluding that the thought of temperament is entirely farfetched.