誰是好的演講者？以多層面Rasch來分析校長三分鐘即席演講的能力

Who is a Good Speaker? Applying Multifaceted Rasch model to analyze Principal Three-minute Impromptu Speech

謝名娟(Ming-Chuan Hsieh)

《教育心理學報》 48卷4期 (2017/06) Pp. 551-566

https://doi.org/10.6251/BEP.20160801

摘要

在儲訓校長的培訓課程中，即席演講為重要的培育能力之一。過去在進行演講評分，大多使用所有評審分數的加總或是平均當作最終的分數，然而，當比賽的人數眾多必須分組時，每一組評審的嚴苛度可能會對成績造成影響。本研究將評分項目、評分委員的嚴苛度放進多層面Rasch模型中估計，進而以較為客觀的方式來評估儲訓校長的口語表達能力。研究結果發現，即使有受過訓練的評分者，在評分過程中，還是有嚴苛度的不同，而儲訓校長在演說上，對於內容、架構，語詞使用、與時間掌控等部份較感困難，而對於發音標準、演說中有合適的語調，具有良好的儀表態度等向度感到較為容易。此外，若忽視納入可能影響的層面而直接使用原始分數總分或是平均做為受試者的成績，可能會造成分數上的誤差與排名的不公。

關鍵字

多層面Rasch ； 即席演講 ； 校長評量

並列摘要

In the pre-service training program, impromptu speech is one of the most important ability to develop for school principals. To assess the speech ability, most researchers use the total or average of the raw scores as final scores. However, when there are many students attending the test, raters need to be divided into several groups to provide grading, and the severity of the raters for different groups may impact students' score. In this study, the scoring criteria, rater's severity and person's ability are all considered into the multifaceted Rasch model. The results show that, even for the trained raters, there still exist subjectivity and different level of rater severity. On the other hand, school principals feel most difficult in content, framework, proper usage of words and time control and feel relative easy in pronunciation, prosody, and appropriate manner in the context of impromptu speech. The ignorance of facets and use the raw total or average score as final score may cause bias or unfairness of the score ranking.

並列關鍵字

multifaceted Rasch model ； school principals evaluation ； speech

參考文獻

姚漢禱、姚偉哲（2008）：應用多層面Rasch 模式分析雙不定向飛靶優秀選手的射擊技術。測驗學刊，55（1），89-104。[Yau, H. D., & Yao, W. C. (2007). Application of many-facet rasch model to analyze the skills of elite athletes in double trap. Psychological Testing, 55(1), 89-104.]

陳木金（2009）：我國國民小學校長儲訓模式的回顧與展望。學校行政雙月刊，60，98-120。[Chen, M. J. (2009). Reviews and prospects for principal preparation training model for elementary school in Taiwan. Journal of School Administration, 60, 98-120]

張榮輝（2009）：臺北縣卓越學校指標的發展歷程, 載於臺北縣政府教育局（主編），2010 臺北縣邁向卓越學校：指標系統與行動方案（9-13）。臺北：臺北縣政府教育局。[Chang, J. H. (2009). Development Procedure for Excellent School Indices in New Taipei city. In 2010 Excellent Schools in New Taipei City: Indices and Action Plan (pp. 9-13). Taipei, Taiwan: New Taipei City Education Bureau.]

張新立、吳舜丞（2008）：多層面Rasch 模式於學術研討會論文評分之應用。測驗學刊，55（1），105-128。[Chang, H. L., & Wu, S. C. (2008). A multi-facet rasch analysis on rating the academic scientific papers. Psychological Testing, 55(1), 105-128.]

高慧容（2007）：蘇格蘭校長培訓制度對我國國小校長培育課程之啟示。學校行政雙月刊，47，27-42。[Kao, H. J. (2007). The implication of scottish qualification for heads/up in curriculum of principal preparation for elementary schools of our country. Journal of School Administration, 47, 27-24.]