【論文摘要】Utilizing Information Technology to Facilitate the Interrater Reliability Assessment

【論文摘要】運用資訊科技促進評分者間信度的探究

羅鴻基(Hong-Ji Luo) ； 李坤璋(Kun-Chang Lee) ； 陳柏禎(Bo-Jhen Chen)

《物理治療》 43卷4期 (2018/12) Pp. 329-330

https://doi.org/10.6215/FJPT.201812.P24

摘要

Background and Purpose: Establishing the reliability and validity is an important procedure prior to incorporating outcome measures into clinical practice. Repetitively performing the required tests, when evaluating the inter- and intra-rater reliability, often takes long time that lowers the researchers' and candidates' will to participate. We aimed to examine the raters' responses of agreement using video recording. Methods: We used the Upright Motor Control Test (UMCT) as an example. The UMCT consisted of flexion/extension component and hip/knee/ankle joints for individuals with stroke. Each item could be completed within forty seconds. Consent to attend the videotaping study was obtained. Video clips of each movement were uploaded to a private playlist on YouTube website. Three raters independently scored a total of six movements and sent the results to the principal investigator. Results: Fifteen patients with stroke were enrolled into the study. The video-sharing website allowed the viewers to rewind and freeze frame the videos. The raters could view the videos in their spare time without repeating the test items. Total time to film and score the performance was completed within two hours. The reliability of subtests were moderate to excellent with percent agreement = 53.3–86.7%, quadratic weighted kappa = 0.564–0.919. Conclusion: Current procedure reduced the time pressure for both clinicians and participants. By means of electronic medium and digital distribution platform, it provided an efficient approach to appraise the interrater reliability. Clinical Relevance: When on-site evaluation is unavailable, information technology would be useful to establish the clinical reliability.