體感語音式操控學習策略對提升英文影片理解之研究

A Gesture-speech Navigated Learning Strategy for Improving the Comprehension of English Videos

許殷嘉(Yin-Chia Hsu) ； 洪逸群(I-Chun Hung) ； 陳年興(Nian-Shing Chen)

《數位學習科技期刊》 5卷1期 (2013/01) Pp. 1-27

https://doi.org/10.3966/2071260X2013010501001

摘要

由於自然人機介面技術的成熟，學習者得以利用體感操作方式進行以肢體活動為媒介之學習應用，藉此讓學習者使用更直覺、自然的方式與學習系統互動。在英文影片學習中，目前仍以鍵盤與滑鼠操作為主，雖然此類操作介面已被廣泛應用，對於多媒體學習而言，直覺性與操作性依然有改善空間。因此，本研究將自然人機介面與語言學習策略進行結合，進而提出「體感語音式操控學習策略」用以促進學習者於觀看英文學習影片時對內容之理解。本研究招募75位大學生與碩士生為實驗對象，結果顯示，在單純改變操作介面的體感操作學習方式下，能改善學習者於學習過程中之認知負荷。學習者在體感語音式操控學習策略的輔助下，學習成效獲得顯著地提升；相較於僅改變操作介面之體感操作學習方式，認知負荷並無顯著地增加。

關鍵字

自然人機介面 ； 認知負荷 ； 語言學習策略 ； 學習成效 ； 體感操作

並列摘要

Learners now can use gestures and speech to intuitively interact with learning system because of the spectacular progress of natural user interface (NUI) technology. Compared with keyboard / mouse, NUI make the interaction between learners and learning system more naturally. Although keyboard / mouse has been widely adopted for a long time, there still has room for improving intuition and operational experience in a multimedia learning environment. This study therefore explores and proposes a new approach by integrating language learning strategies into a gesture-speech navigated learning system for improving learners' comprehension of English videos content. An experiment was conducted with 75 undergraduate and postgraduate students. The result showed that the gesture-speech navigated learning strategy can significantly improve learners' comprehension of English videos. Meanwhile, the cognitive load is also under control and acceptable without significant increase.

並列關鍵字

natural user interface ； cognitive load ； language learning strategies ； learning performance ； gesture-based oper

參考文獻

Amadieu, F.,Marine, C.,Laimay, C.(2011).The attention-guiding effect and cognitive load in the comprehension of animations.Computers in Human Behavior.27(1),36-40.

Brunken, R.,Plass, J. L.,Leutner, D.(2003).Direct measurement of cognitive load in multimedia learning.Educational Psychologist.38(1),53-61.

Chen, C.-M.,Chung, C.-J.(2008).Personalized mobile English vocabulary learning system based on item response theory and learning memory cycle.Computers & Education.51(2),624-645.

Dias, L. B.(1999).Integrating technology.Learning and Leading with Technology.27(3),10-13+21.

Huang, W.-H.(2011).Evaluating learners' motivational and cognitive processing in an online game-based learning environment.Computers in Human Behavior.27(2),694-704.