四種翻譯評量工具的比較

A Comparison of Four Assessment Tools for Translation Tests

賴慈芸(Tzu-Yun Lai)

《編譯論叢》 1卷1期 (2008/09) Pp. 71-91

https://doi.org/10.29912/CTR.200809.0003

摘要

本研究比較下列四種翻譯評量工具的評分結果：根據國立編譯館「建立國家翻譯人才評鑑標準第二期研究」所提出的量表評分方法（「忠實」／「通順」各五分量表，獨立評分）、錯誤扣分法，以及兩種修正的量表評分方法。第一種修正方法是比例不變，但改為合併評分（「正確」／「表達」各五分量表，合併評分）；第二種修正方法是加重訊息正確的比例（「訊息準確」六分，「表達風格」四分，合併評分）。研究者從前述研究中抽取30份答卷作為評分樣本，共有12位翻譯教師／專業譯者參與評分。研究結果發現，在英譯中組的部分，修正後的兩種量表評分法都與錯誤扣分法達到高度相關，但第二期研究的量表評分法與錯誤扣分法只有中度相關，表示合併評分的三種方法較為一致；其中「六／四評分法」的評分人間信度最高，與錯誤評分法的相關度也最高，可知為穩定而有效的工具。在中譯英組部分，「六／四評分法」的評分人間信度也是最高，但四種評分法的結果都達到高度相關，差異不大。

關鍵字

翻譯測驗 ； 翻譯評量 ； 評量工具 ； 量表評分 ； 錯誤扣分法

並列摘要

This study compares four assessments used in translation tests: a scale-based method proposed by Liu Minhua et al in ＂A Study on the Establishment of National Assessment Criteria of Translator and Interpreters, Phase II＂ (2005), the error-analysis-based method applied by most schools and institutions, and two modified assessments based on Liu's method. In the present study, twelve graders were invited to re-grade 30 papers in Liu's experiment by the other three methods. The result of the English-Chinese group showed that the two modified scale methods both reached a high correlation with the error analysis method while Liu's scales only reached a medium correlation. The inter-rater correlation of the 6/4 scale (6 grades for ＂Accuracy＂ and 4 grades for ＂Expression＂) was the highest among all the methods used in the research. The correlation between the 6/4 scale and error-analysis method was also the highest. It showed the 6/4 scale method was a reliable and valid assessment tool. In the Chinese-English group, however, the results of the four methods were similar, although the inter-rater correlation of the 6/4 scale was still the highest among the four.

並列關鍵字

translation test ； translation assessment ； assessment tools ； assessment scales ； error-analysis

參考文獻

Colina, S.(2003).Translation teaching, from research to the classroom: A handbook for teachers.Boston:McGraw-Hill.

Ganschow, L.(1991).Identifying native language difficulties among foreign language learners in college: A "foreign" language learning disability?.Journal of Learning Disabilities.24(9),530-541.

Schäffner, C.(Ed.),Adab, B.(Ed.)(2000).Developing translation competence.Amsterdam:John Benjamins.

Stansfield, C. W.,Scott, M. L.,Kenyon, D. M.(1992).The measurement o f translation ability.The Modern Language Journal.76(iv),455-467.

Waddington, C.(2001).Different methods of evaluating student translations: The question of validity.Meta.XLVI,311-325.