效果量在臺灣心理與教育期刊的應用：回顧與再思

Effect Size Reporting Practices in Taiwanese Psychology and Education Journals: Review and Beyond

Li-Ting Chen ； 丁麒文(Qi-Wen Ding) ； 謝承佑(Cheng-Yu Hsieh) ； 陳奕凱(Yi-Kai Chen) ； 江宇珊(Yu-Shan Chiang) ； 黃思婧(Ssu-Ching Huang) ； 楊同榮(Tong-Rong Yang) ； 鄭澈(Che Cheng) ； 劉佩艷(Pey-Yan Liou) ； 彭昭英(Chao-Ying Joanne Peng)

《中華心理學刊》 62卷4期 (2020/12) Pp. 553-592

https://doi.org/10.6129/CJP.202012_62(4).0006

摘要

雖然效果量在量化實徵研究裡十分重要，但過去尚未有研究探討效果量在臺灣心理學與教育學的應用情況。本研究系統性地回顧了2017年與2018年發表在臺灣具高評價的八本心理學與九本教育學期刊，一共268篇文章，旨在探討四個報告效果量的面向：（1）效果量報告的比例、（2）效果量報告的類型、（3）效果量的解釋，以及（4）作者如何處理統計顯著性與效果量強度的落差。結果顯示：72%的文章報告至少一個效果量，超過65%的效果量是r類型（如：Pearson相關係數或η^2）。在報告效果量的文章中，55%解釋了效果量，80%以上對效果量的解釋僅以小、中或大的標籤標註。在同時報告統計顯著性與效果量的文章裡，50%呈現兩者間有落差的問題，其中僅有35%對落差提供解釋。就兩學門的比較而言，儘管心理學期刊文章報告效果量的比例顯著地低於教育學，然而教育學文章使用標籤化的方式解釋效果量之比例卻顯著地高於心理學。整體而言，大多數的作者報告了效果量，卻未必對效果量的意涵提供完整的解釋。本文提出五點效果量報告之建議與四個效果量報告的範例，希冀能幫助讀者在研究報告中正確地闡述效果量的意涵，並促進效果量在量化研究之廣泛應用。

關鍵字

研究報告慣例 ； 效果量 ； 統計推論 ； 實務顯著性 ； 臨床顯著性

並列摘要

The importance of reporting effect sizes (ESs) in quantitative empirical studies has been emphasized in the literature. However, no published study to date has shed light on current ES reporting practices in Taiwanese psychology and education journals. To fill this gap, the present study systematically reviewed 268 articles published in eight Taiwanese psychology journals and nine education journals during 2017 and 2018. All of these 17 journals were highly ranked in their respective fields. Four aspects of ES reporting practices were investigated: (A) the ES reporting rate, (B) the ES type, (C) the ES interpretation, and (D) the resolution of discrepancies between the ES magnitude and statistical significance. The results revealed that 72% of articles reported at least one ES, and more than 65% of ESs reported were the r-type, such as Pearson's r and η^2. Of the studies that reported ESs, 55% also interpreted the ESs. More than 80% of these interpretations were the mere labeling of an ES as small, medium, or large, according to established benchmarks. Approximately 50% of the articles showed a discrepancy between the magnitude of an ES and its corresponding statistical significance, but only 35% of these articles attempted to explain or resolve the discrepancy. When the data for psychology and education articles were analyzed separately, the psychology articles exhibited a lower rate of both ES reporting and ES interpretation by labeling. In sum, the majority of articles reported at least one ES, but few interpreted ES fully or meaningfully. To assist authors with a full and meaningful ES reporting, we offer five suggestions and one exemplary ES reporting in the Extended Abstract. It is hoped that this paper contributes to an increased practice of meaningfully reporting ES(s) in empirical quantitative studies in Taiwan.

並列關鍵字

clinical significance ； effect size ； practical significance ； reporting practice ； statistical inference

參考文獻

邱倚璿（2017）：〈時間次序與空間位置訊息於記憶運作中的運用：以失聰手語使用者為例〉。《特殊教育研究學刊》，42（3），93-117。[Chiu, Y.-S. (2017). Temporal order and spatial information in short-term memory: Evidence from deaf Taiwanese signers. Bulletin of Special Education, 42(3), 93-117.] doi: 10.6172/BSE.201711_42(3).0004

陳淑麗、曾世杰、林慧敏（2018）：〈以讀寫合一課程提昇五年級偏鄉地區學生的寫作能力〉。《教育研究與發展期刊》，14（4），71-100。[Chen, S.-L., Tzeng, S.-J., & Lin, H.-M. (2018). Raising the writing ability of grade 5 students from schools in rural Taiwan using a reading and writing bi-focal curriculum. Journal of Educational Research and Development, 14(4), 71-100.] doi: 10.3966/181665042018121404003

陳淑麗、曾世杰、張毓仁、蔡佩津（2017）：〈永齡國語文補救教學方案及補救教師專業背景對國小二年級學生讀寫進展之成效研究〉。《特殊教育研究學刊》，42（2），85-111。[Chen, S.-L., Tzeng, S.-J., Chang, Y.-J., & Tsai, P.-C. (2017). Effects of the Young-Ling remedial program and teachers’ professional background on the literacy progress of second graders. Bulletin of Special Education, 42(2), 85-111.] doi: 10.6172/BSE.2017.07.4202004

翁儷禎、黃怡蓉、鄭中平（2012）：〈2008 年台灣心理學門學術期刊評比研究〉。《中華心理學刊》，54，413-431。[Weng, L.-J., Huang, Y.-J., & Cheng, C.-P. (2012). An evaluation of psychology journals in Taiwan in 2008. Chinese Journal of Psychology, 54, 413-431.] doi: 10.6129/CJP.20120329

葉光輝、鄭欣佩、楊永瑞（2005）：〈母親的後設情緒理念對國小子女依附傾向的影響〉。《中華心理學刊》，47，181-195。[Yeh, K.-H., Cheng, S.-P., & Yang, Y.-J. (2005). The influence of maternal meta emotion philosophy on children’s attachment inclination. Chinese Journal of Psychology, 47, 181-195.] doi: 10.6129/CJP.2005.4702.06