This paper introduces a color-banded hand tracking system (CbHTS) based on fuzzy logic concept. Human-computer interaction interface is a rising field of research in recent years. Among them, the hand tracking method based on image processing holds the most advantages. This research applied fuzzy logic on image processing to recognize the color bands pre-banded on user's fingers. By analyzing the coordinate of the color bands, CbHTS can then be used to obtain the effect of hand tracking. If the tracking performance of our system could be promoted to increase the frame rate and the precision of detection in the near future, it would be possible to substitute CbHTS for the function of traditional mouse to offer a more intuitive operation environment in human-computer interaction interface.