Development of an Abridged Version of Tutotest-C to Assess Students' Performance in Problem-based Learning Tutorials

Wei-Dean Wang ； Fen-Yu Tseng ； Kai-Kuen Leung

《Journal of Medical Education》 16卷2期 (2012/06) Pp. 16-23

https://doi.org/10.6145/jme.201206_16(2).0003

並列摘要

Purpose: The 44 items Chinese version Tutotest (Tutotest-C) had been developed with good validity and reliability. However, opinions from tutors with one year experience on implementation raised several common questions including the lengthy item to be too time consuming to be used and several items need extensive modification before the instrument can be practically useful in real situation. Methods: Items of variable importance and adequacy were identified using questionnaire survey. The item number of Tutotest-C was reduced by using both statistical approach and expert-based approach methods. The psychometric properties of an abridged version Tutotest-C were examined by actual implementation of the instrument to 258 PBL tutorial students by 48 experienced tutors at national Taiwan University College of Medicine from 2008 to 2009. Psychometric properties were examined by factor analysis and internal consistency analysis. Results: A total of 34 items with consistent importance and adequacy were identified to create an abridged version of Tutotest-C. Sampling adequacy analysis revealed a Kaiser-Meyer-Olkin value of 0.934 and a significant Bartlett's test of sphericity (X561^2 = 4506.11; p ＜ 0.001). Principal factor analysis of the 2008 data revealed 6 factors with eigenvalue greater than 1, however, a 5-factor structure reproduced the best theoretical categories of the scale which could explain 58.34% of the total variance. Conclusion: It is believed that the shortened version of Tutotest-C is more practical, able to reduce overall cost of implementation, and to acquire better compliance and cooperation of respondents.

並列關鍵字

problem-based learning ； evaluation ； Tutotest ； Tutotest-C

參考文獻

Barrows, H. S.,Tamblyn, R.(1980).Problem-based Learning: An Approach to Medical Education.New York:Springer.

Cindy E., Hmelo-Silver(2004).Problem-based learning: what and how do students learn?.Educ Psychol Rev.16(3),235-66.

Walton, H. J.,Matthews, M. B.(1989).Essentials of problembased learning.Med Educ.23,542-58.

Hébert, R.,Bravo, G.(1996).Development and validation of an evaluation instrument for medical students in tutorials.Acad Med.71,488-94.

Des Marchais, J. E.,Vu, N. V.(1996).Development and evaluating the student assessment system in the preclinical problem-based curriculum at Sherbrooke.Acad Med.71(3),274-83.