以Kinect 結合語音辨識協助精神障礙者備餐工作之研究

Using kinect and speech recognition to assist people with cognitive impairment for vocational rehabilitation.

陳以邵(Yi-Shao Chen)

指導教授 ： 張耀仁

中原大學/電機資訊學院/通訊工程碩士學位學程/碩士(2014年)

https://doi.org/10.6840/cycu201400688

摘要

本研究利用Kinect結合語音辨識系統開發一套工作提示輔具，本系統能夠替使用者記錄工作內容，並且在使用者工作發生錯誤時給予立即的錯誤提示，目的在於提高精神障礙者在工作上的完整度。精神障礙者由於需服用藥物控制病情，常因藥物的副作用使精神障礙者的認知與反應能力下降，進而導致工作時會遺忘或是漏失工作項目，影響工作表現，故本研究希望透過系統的即時提醒功能，提升精神障礙者工作完成率，促進精神障礙者就業。
輔具完成後，在台灣身心障礙者就業權益促進協會的協助下，本研究邀請三位精神障礙者實際參與使用者個案研究，目的在於了解本系統使否能夠減少精神障礙者工作時發生錯誤的情形，並且提高工作成功率。

關鍵字

精神障礙 ； 工作提示 ； Kinect ； 語音辨識

並列摘要

In this study, we aimed to use Kinect and speech recognition to develop task prompting system for people with cognitive impairment. To improve the integrity in their work, this system will record the content of work, and give user immediate error message when an error occurs. By using drug treatment for mental illness, people will suffer from side effect, like reducing the physical and cognitive ability to respond. This will affect the performance when they are working. With using this task prompting system, we hope that we can improve the job performance for them.
After the design of the system, we hold a experiment and invite three cognitive impairments to test our system. We want to know whether this system can improve their success rate of their work.

並列關鍵字

Cognitive Impairments ； Task prompting ； speech recognition. ； Kinect

參考文獻

[11] Yao-Jen Chang, Wan-Chih Chang, Tsen-Yung Wang, “Context-aware Task Prompting System with Multiple Modalities for Individuals with Cognitive Impairments” Journal of Advanced Engineering Vol. 5, No. 3, pp. 245-254 / July 2010

[1] Goldsmith, T. R., & LeBlanc, L. A. (2004) .Use of technologyin interventions for children with autism. Journal of Early andIntensive Behavior Intervention, 1, 166–178.

[6] 吳宜容、蘇純瑩、陸悌、林淑鈴、李佳盈、陳吟星、汪宜霈，“雇主與就服員對影響精神障礙者就業因素之觀點探討”職能治療學會雜誌，民國九十八年第二七卷第一期.

[7] Carson, K. D., Gast, D. L.& Ayres, K. M. (2008). “Effects ofaphoto activity schedule book on independent task changes by student with intellectual disabilities in community job sites.” European Journal of Special Needs,23, 269 –279.

[9] Van Laarhoven, T., Johnson, J. W., Van Laarhoven-Myers, Grider, K. L., & Grider, K. M. (2009). The effectiveness of using a video iPod as a prompting device in employment settings. Journal of Behavioral Education, 18 (2), 119–141.