應用三軸加速度感測器與隱馬爾可夫模型
發展智慧型人機互動系統

傳統人與電腦溝通的方式，主要是透過滑鼠或鍵盤來進行。然而，隨著資訊科技的發展，遠端操作的人機互動被廣泛地應用於虛擬實境、互動電視等。尤其，當使用者面對特殊的應用或遠距操控的情境時，傳統的操作介面就顯得不夠直覺流暢。因此，本研究發展智慧型人機互動系統，採用任天堂Wii Remote來做為介面裝置，可透過內建之三軸加速度感測器（3-axis accelerometer）擷取使用者動作資料，並結合隱馬爾可夫模型（Hidden Markov Model）來建立訓練模型以辨識手部動作之三軸加速度組態。使用者可以依照自我需求設定人機互動的應用，自行設定手部互動動作型態，以便操作各種不同情境下的人機互動系統。本研究以設計微軟數位生活中心(Vista MCE)影音播放器以及操控藍牙遙控車兩個範例，進行實驗測試，以評估系統之可使用性(usability)，實驗評估結果顯示，受測者對於所發展的人機互動系統感到滿意，最後，根據研究評估結果，可提供未來發展智慧型人機互動系統開發之建議。

關鍵字

手勢辨識； Wii Remote ；隱馬爾可夫模型；加速度感測器；人機介面

並列摘要

The interface among human and computer, usually using the keyboard and mouse. Along with the continuous changes and improvement of information technology, remote controls are widely used in virtual reality, interactive TV, Sign language systems, and so on. The new information technologies allow developing new interactions methods. However the human-computer interaction needs to be diversified in the future. In particular, users are not intuitive when applying a special application or remote control environment, thus, this study applying Nintendo Wii remote as a human-computer interface device, to capture motion data by built-in three-axis accelerometer sensor, and training and recognize with Hidden Markov Model. First, we implement a gesture recognize system, to enhance the interactive ability of three-axis accelerometer sensor, gesture commands are trainable by user on-demand, and users can interactive with different computer applications through the gesture command has been trained. This study designed two experiment testing include: Vista MCE and Bluetooth car, for evaluating usability of the proposed system. Finally, this study developed a questionnaire based on usability engineering for evaluating the proposed human computer interactive system after experiments. The experimental results show the proposed system are generally well accepted by users. In the end , this study had issued some suggestions for intelligent interactive system design and for future study.

並列關鍵字

Gesture Recognition ； Wii Remote ； Hidden Markov Model ； Accelerometer ； Human Computer Interaction

參考文獻

Abou-Moustafa, K.T. , Cheriet, M., Suen , C.Y. (2004). On the structure of hidden Markov models , Pattern Recognition Letters 25, 923 - 931.

Baum, L. E. and Petrie, T. (1966). Statistical inference for probabilistic functions of finite state Markov chains,” Annals of the Institute of Statistical Mathematics, vol. 37, no. 5, 1554 - 1563.

Bui ,T.D., Nguyen, L.T., (2007). Recognizing Postures in Vietnamese Sign Language With MEMS Accelerometers, Sensors Journal, IEEE Volume 7 Issue 5 May, 707 – 712.

Cho, S.J. , Roderick, Murray-Smith , Kim,Yeun-Bae, (2007). Multi-Context Photo Browsing on Mobile Devices Based on Tilt Dynamics , Mobile HCI'07, September 9-12, 2007, Singapore.

Feng, S., Manmatha, R., (2006). Hierarchical, HMM-based Automatic Evaluation of OCR Accuracy for a Digital Library of Books JCDL’06, June 11 - 15, 2006, Chapel Hill, North Carolina, USA.

國際替代計量

應用三軸加速度感測器與隱馬爾可夫模型發展智慧型人機互動系統

全文下載

主題瀏覽