簡易檢索 / 詳目顯示

研究生: 莊敬璞
Ching-Pu Chuang
論文名稱: 基於情緒識別技術探討動畫互動型多媒體教材對於學習情緒、認知負荷及學習成效之影響
Using Emotion Recognition Technology to Assess the Effects of Interactive Animation Multimedia Materials on Learning Emotion, Cognitive Load and Learning Performance
指導教授: 陳志銘
Chen, Chih-Ming
洪欽銘
Hong, Chin-Ming
學位類別: 碩士
Master
系所名稱: 電機工程學系
Department of Electrical Engineering
論文出版年: 2012
畢業學年度: 100
語文別: 中文
論文頁數: 85
中文關鍵詞: 認知負荷學習情緒情緒識別多媒體教材認知風格
英文關鍵詞: Cognitive load, Learning Emotion, Emotion Recognition, Multimedia Learning Materials, Cognitive style
論文種類: 學術論文
相關次數: 點閱:98下載:26
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 動畫互動型多媒體教材可促使學習者和教材間產生對話及互動,提供較佳的視覺效果,也有助於提升學習者的學習興趣,因此目前動畫互動型多媒體教材已是多媒體教材設計的主流。探討動畫互動多媒體教材設計對於學習者的學習情緒、認知負荷及學習成效影響,有助於調整動畫互動型多媒體教材的設計,進而降低學習者的認知負荷,致使產生好的學習情緒而提升學習成效。而探討動畫互動多媒體教材對於不同認知風格及性別學習者之學習情緒、學習成效及認知負荷影響差異,則有助於發展適性化動畫互動多媒體教材。
    因此,本研究使用情緒壓力感測儀emWave及認知負荷量表,量測學習者的學習情緒變化及評估其產生的認知負荷,以探討動畫互動型多媒體教材對於學習者的學習情緒、學習成效及認知負荷影響;又動畫互動型多媒體教材對於文字型及圖像型認知風格學習者,是否具有學習情緒、學習成效及認知負荷上的影響差異;再則,動畫互動型多媒體教材對於不同性別學習者,是否具有學習情緒、學習成效及認知負荷上的影響差異。研究結果發現,認知負荷高之學習者在使用動畫互動型多媒體教材進行學習時,其學習情緒與認知負荷具有顯著相關;認知負荷分量中的難易度可預測正負面情緒;不同性別之高認知負荷學習者其整體認知負荷及正負面情緒具有顯著差異;且不同學習風格之學習者其認知負荷具有顯著差異。

    Animated, interactive multimedia learning materials can encourage dialog and interaction between learners and the materials themselves, providing superior visual effects and assisting in the promotion of interest in learning. Therefore, these types of materials are currently at the forefront in the design of multimedia learning materials. Investigating the influence of these materials on the emotions, cognitive load, and learning effectiveness of learners of different genders and cognitive style is helpful in adjusting the design of the materials; thereby reducing the cognitive load on learners, engendering healthy learning emotions, and improving learning effectiveness.
    Therefore, this study used the emotional pressure-sensing device emWave and a cognitive load scale to examine the influence of animated, interactive multimedia learning materials on the learning emotions, learning effectiveness, and cognitive loads of learners, and whether differences in these factors exist among learners with Visualizer / Verbalizer cognitive styles of learning, and between learners of different genders. The results of this study indicated that a significant correlation existed between the learning emotions and cognitive loads of learners with high cognitive loads when using animated, interactive learning materials. The difficulty in the components of the cognitive load can predict positive or negative emotions. Significant differences also existed between the overall cognitive loads and emotions of learners of different genders with high cognitive loads. In addition, significant discrepancies existed in the cognitive loads of learners with differing learning styles.

    摘 要 i ABSTRACT iii 誌 謝 v 目錄 vii 圖目錄 ix 表目錄 x 第一章  緒論 1 1.1研究動機與背景 1 1.2 研究目的 2 1.3 待答問題 3 1.4 研究範圍與限制 4 1.5 名詞解釋 5 1.6 論文架構 6 第二章文獻探討 9 2.1 認知負荷 9 2.2學習情緒 14 2.3生理資訊與情緒識別技術 16 2.4多媒體教材 22 2.5認知風格 23 第三章研究方法 26 3.1 研究架構 26 3.2 實驗設計 27 3.3 研究對象 30 3.4 研究工具 31 3.4.1 分數單元之多媒體教材 31 3.4.2 學習情緒識別 33 3.4.3 人機互動軟體分析 37 3.4.4 認知負荷量表 38 3.4.5 認知風格量表 38 3.5 資料分析 39 第四章資料分析 41 4.1樣本基本資料分析 41 4.2量表之信度分析 42 4.3實驗分析 44 第五章 結論與未來研究方向 60 5.1結論 60 5.2討論 63 5.3未來研究方向 64 參考文獻 67 附錄一:前測學習單 74 附錄二:後測學習單 75 附錄三:認知負荷量表 76 附錄四:SOP認知風格量表 78 附錄五:家長同意書 83 附錄六:石門國小照片 84 附錄七:榮富國小照片 85

    中文部份
    王惠平,基於情緒識別技術評估不同型態多媒體教材之學習情緒及成效研究國立臺灣師範大學應用電子科技研究所碩士論文,2010。
    李俊青,學業情緒歷程模式之分析。國立成功大學教育研究所碩士論文,2007。
    孫櫻純,圖像及文字型認知風格學習者在學習不同型態多媒體教材時之學習情緒及成效評估研究,國立臺灣師範大學應用電子科技研究所碩士論文,2010。
    郭璟諭,媒體組合方式與認知風格對學習成效與認知負荷之影響,國立中央大學資訊管理研究所碩士論文,2003。
    陳密桃,認知負荷理論及其對教學的啟示。教育學刊,21,29-51,2003。
    范懿文,陳彙芳,認知負荷對多媒體電腦輔助學習成效之影響研究,資訊管理研究,第二卷,45-60,2000。
    張美惠,基因演算法在網路教學個人化學習路徑之建立,國立花蓮教育大學學習科技研究所碩士論文,2006。
    慎基德,以生理訊號探討多媒體環境之使用者情感反應,國立台灣大學電機工程學研究所碩士論文,2006。
    彭祈叡,Ontology在支援個人化學習路徑建構之研究,國立花蓮教育大學學習科技研究所碩士論文,2007。

    英文部分
    Bercht, M., & Viccari, R. (2000). Pedagogical agents with affective and cognitive dimensions. In Proceedings of the Congreso Iberoamericnao de Informatica Educativa, Vina del Mar.
    Chan Lin, L. J. (1998). Animation to teach students of different knowledge levels. Journal of Instructional Psychology, 25(3), 166-175.
    Chang, T., & Chang, D. (2004). Enhancing learning experience with dynamic animation. In Proceedings of international conference on engineering education. University of Florida, October 17-21
    Childers, Terry L., Houston, Michael J., Susan E., & Heckler(1985). Measurement of individual differences in visual versus verbal information processing. Journal of Consumer Research, S.E., 12, 125-134.
    Chuang Y-R (1999) Teaching in a multimedia computer environment: a study of effects of learningstyle, gender, and math achievement.
    Chih-Ming Chen& Hui-Ping Wang.(2011). Using emotion recognition technology to assess the effects of different multimedia materials on learning emotion and performance, Library & Information Science Research, Vol.33, 244-255.
    De Vicente, A., & Pain, H. (2002). Informing the Detection of the Students' Motivational State: An Empirical Study. International Conference on Intelligent Tutoring Systems, 933-943.
    Dunn, R., Dunn, K.(1993). Teaching Secondary Students Through Their Individualized Learning Styles. Reston, VA: Reston Publishing Co.
    Eija Haapalainen, SeungJun Kim, Jodi F. Forlizzi, Anind K. Dey. (2010) Psycho-Physiological Measures for Assessing Cognitive Load. UbiComp ‘10, Sep 26–Sep 29, 2010, Copenhagen, Denmark.
    Ekman, P. (1999). Basic emotions. In Dagleish, T. and Power, M., editors, Handbook of Cognition and Emotion, pp. 45–60. Wiley, New York.
    Emmanuel, B., Pierre, C., & Claude, F. (2007). Towards advanced learner modeling: discussions on quasi real-time adaptation with physiological data. Seventh IEEE International Conference on Advanced Learning Technologies (ICALT 2007), 809-813.
    Guilford, J.P. (1959). Personality, N.Y., &McGraw-Hill
    Gheorghita Ghinea, Sherry Y. Chen. (2003). British Journal of Educational Technology. 34(4) 393–406.
    Jaques, P. A., & Viccari, R. M. (2006). Considering Students’ Emotions in Computer-mediated Learning Environments. In Z. Ma (Ed.), Web-based intelligent e-learning systems: Technologies and applications (pp. 122-138). Hershey, PA: Information Science Publishing.
    Jonassen, D. (1988). Instructional designs for microcomputer courseware. Hillsdale, NJ: Lawrence Erlbaum.
    Jonghwa, K. (2007). Robust Speech Recognition and Understanding. In M. Grimm & K. Kroschel(Eds.), Bimodal Emotion Recognition using Speech and Physiological Changes (pp. 265-280). Austria: I-Tech Education and Publishing.
    Kalyuga, S. (2000). When using sound with a text or picture is not beneficial for learning, Australian Journal of Educational Technology, 2002, 16(2), 161-172.
    Kalyuga, S., Chandler, P., & Sweller, J. (2000). Incorporating learner experience into the design of multimedia instruction. Journal of Educational Psychology, 92(1), 126
    Kirby, John R., Phillip J. Moore, and Neville J. Schofield. (1988). Verbal and Visual Laerning Styles. Contemporary Educational Psychology 13, 169-184.
    Kopecek, I. (2000). Emotions and Prosody in Dialogues: An Algebraic Approach Based on User Modelling. In The Proceedings of the ISCA Workshop on Speech and Emotions. Belfast: ISCA, pp. 184-189.
    Kort, B., Reilly, R., and Picard, R.W. (2001). An Affective Model of Interplay Between Emotions and Learning: Reengineering Educational Pedagogy—Building a Learning Companion. In Proceedings of ICALT.
    Large, A., Beheshti, J., Breuleux, A., and Renaud, A. (1994). Multimedia and comprehension: a cognitive study. Journal of the American Society for Information Science, 45(7), 515-528.
    Leplat, J.(1978). Factors determining workload. Ergonomics, 21, 143-149.
    Likert, & Rensis(1932). A Technique for the Measurement of Attitudes. Archives of Psychology, 140. pp. 1-55.
    Lowe, R. K. (2003). Animation and learning: selective processing of information in dynamic graphics. Learning and Instruction. 13(2), 157-176.
    Marcus, N., Cooper, M., & Sweller, J(1996) Understanding instruction. Journal of Educational Psychology, 88(1), 49-63.
    Marsh, H. W., & Yeung, A. S (1997). Coursework selection: The effects of self-concept and achievement. American Educational Research Journal, 34, 691-720.
    Mayer, R. E. (1997). Multimedia learning: Are we asking the right questions?. Educational Psychologist, 32(1), 1-19.
    Mayer, R.E., & Moreno, R. (1998). A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of Educational Psychology, 90, 312-320.
    Messick, S.(1984). The nature of cognitive styles: Problems and promise in educational practice.Educational Psychologist, 19 (1), 59-74.
    Messick, S.(1978).Individuality in learning. San Francisco: Jossey-Bass.
    Moray,N. (1982). Subjective mental workload. Human Factor, 24 ,25-40.
    Mousavi, S. Y., Low, R., & Sweller, J. (1995). Reducing cognitive load by mixing auditory and visual presentation modes. Journalof Educational Psychology, 87(2), 319-334.
    Nunnally,J.C.,(1978). Psychometric theory, New York, McGraw Hill.
    Paas, F. G. W., van Merrienboer, J. J. G. (1993). The efficiency of instructional conditions: An approach to combine mental effort and performances Human Factor, 35,737-743.
    Paas, F.G.W.C., and Van Merriënboer, J.J.G., (1994). Variability of worked examples and transfer of geometrical problem-solving skills: A cognitive-load approach, Journal of Educational Psychology, 86(1), 122-133.
    Paas, F. G. W., van Merrienboer, J. J. G., & Adam, J. J. (1994). Measurementof cognitive load in educational research. Perceptual and Motor Skills, 79,419-430.
    Paivio, A.(1971). Imagery and verbal processes. New York: Holt, Rinehart, and Winston.
    Pedro Paredes, & Pilar Rodriguez(2006). The application of learning styles in both individual and collaborative learning. Advanced Learning Technologies.
    Pekrun, R., Goetz, T., & Titz, W. (2002). Academic emotions in students’ self-regulated learning and achievement : A program of qualitative and quantitative research. Educational Psychologist, 37(2), 91-105.
    Piaget, J., (1989). Les relations entre l’intelligence et l’affectivité dans le developpement de l’enfant. Rimé, B.; Scherer, K. (Eds.) Les Émotions. Textes de base en psychologie. Paris: Delachaux et Niestlé. 75-95.
    Picard R. W., Healey, J., & Vyzas, E. (2001). Toward Machine Emotional Intelligence: Analysis of Affective Physiological State. IEEE Transactions Pattern Analysis and Machine Intelligence, 23(10), 1175-1191.
    Richardson, A.(1977).Verbalizer-visualizer: A cognitive style dimension.Journal of Mental Imagery, 1(1), 109-126.
    Rieber, L. P., & Hannafin, M. J. (1988 ). Effects of textual and animated orienting activities and practice on learning from computer-based instruction. Computers in the Schools, 5, 77-89.
    Sabine Graf, Chung Hsien Lan, Tzu-Chien Liu, Kinshuk(2009). Investigations about the Effects and Effectiveness of Adaptivity for Students with Different Learning Styles.ICALT, 415-419
    Shen, L., Wang, M., &Shen, R. (2009). Affective e-Learning: Using “Emotional” Data to Improve Learning in Pervasive Learning Environment. Educational Technology & Society, 12 (2), 176–189.
    Smith, S.M., Woody, P.C(2000). Interactive effect of multimedia instruction and learning styles.Teaching of Psychology, 27(3), 220-223.
    Sweller, J., Van Merrienboer, J.J.G., and Paas, F.G.W.C. (1998). Cognitive architecture and instructional design, Educational Psychology Review, 10(3), 251-297.
    Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12, 257-285.
    Tcherkassof, A. (1999) Les indices de préparation à l’action et la reconnaissance des expressions émotionnelles faciales. Revue Européenne de Psychologie Appliquée, 49(2), 99-105.
    Tulga, M, K. (1978). Dynamic decision making in multitask supervisory control: Comparison of an optimal algorithm to human behavior. Cambridge, MA: MIT Man-Machine Systems Laboratory.
    Vaughan, T.(1993). Multimedia: Making it Work, New York: McGraw-Hill.
    Wang, H., Prendinger, H., & Igarashi, T. (2004). Communicating Emotions in Online Chat Using Physiological Sensors and Animated Text. In Proceedings of the 1st international conference for human-computer interaction, 1171-1174.
    Ward, S.L., Newcombe, N., & Overton, W.F. Turn left at the church, or three miles North. A study of direction giving and sex differences.
    Wehrle, T., & Kaiser, S. (2000). Emotion and Facial Expression. In A. Paiva (Ed.), Affect in Interactions: Towards a new generation of interfaces (pp. 49-63). Heidelberg: Springer.
    Wierwille, W.W., and Eggmeier, F.L. (1993). Recommendations for mental workload measurement in a test and evaluation environment, Human Factor, 35, 263-281.
    Witkin, H. A., Moore, C. A., Owen, D. R., & Raskin, E. (1977). Role of the field-dependence and field-independence cognitive style in academic evolution: A longitudinal study. Journal of Educational Psychology, 69(3), 197-211.
    Yeung, A. S., Lee, C. F. K., Pena, I. M. & Ryde, J. (2000). Toward a subjective mental workload measure. Paper presented at the International Congress for School Effectiveness and Improvement, Hong Kong, China.
    Yoshitake, H. (1971). Relation between the symptoms and the feelings of fatique. Ergonomics, 14, 175-186.

    下載圖示
    QR CODE