Color plays an important role in the era of visual information transmission. When designers devise graphics, texts and backgrounds, they used to enhance the power of communication by color configuration, in order to catch viewers' attention and enhance viewers' memory in a short time. In this study, I used the one way ANOVA, biserial correlation and the independent sample t test to investigate the differences and relationships between hue, color saturation and gender in short-term memory performance, respectively, to provide reference for researchers and designers to apply in related fields. The results show that the hue and color saturation of different background colors have a significant impact on the correct number and error rate of short-term memory answers. However, It is unrelated with gender.