Traditional Chinese herbal medicines have natural colors, a historical style, and natural pharmacological functions; therefore, using Chinese herbal medicines to dye cotton fiber has received increasing attention from the general public. In this study, we extracted dye from Chinese herbal medicine before applying it to cotton fiber to test its fastness and color changes under different mordants. We obtained the following results: (1) Chinese herbal medicines with different mordants and pH values were applied to the cotton fibers to fully test their effects. When ferrous sulfate was applied as a mordant, the color difference (K/S) was the highest at pH 5, especially when Rhus chinensis with polyphenols were used (with a K/S value of 57.68). (2) After mordant treatment, the brightness significantly decreased, especially when ferrous sulfate is used as the mordant. This condition becomes even more prominent when using Rhus chinensis with polyphenols.