Due to the rapid development of computer hardware design and software technology, the user demands of electric products are increasing gradually. Different from the traditional user interface, such as keyboard and mouse, some new human computer interactive system like the multi-touch technology of Apple iPhone and the touch screen support of Windows 7 are catching more and more attention. For medical treatment, there are some eye-gaze tracking systems developed for cerebral palsy and multiple sclerosis patients. In this thesis, we propose a real-time, accurate, and robust smile detection system.