結合語音與影像處理技術協助精障者備餐工作之可行性研究

Feasibility Study of Speech and Image Processing technology to assist people with cognitive impairment for vocational rehabilitation

魏子崴(Tzu-Wei Wei)

指導教授 ： 張耀仁

中原大學/電機資訊學院/通訊工程碩士學位學程/碩士(2013年)

https://doi.org/10.6840/CYCU.2013.00092

摘要

本研究旨在將數位影像處理與語音辨識之技術引入工作提示輔具，提升精神障礙者進入就業職場前之職前訓練的準備，進而節省就輔員與職場主管訓練精障者的時間。精神障礙者需要以藥物控制病情，但藥物帶來的副作用會減低精障者在工作上的認知與反應能力，進而影響日常生活與職場上的表現。在工作時會使用工作提示的方法以輔導，傳統上的工作提示有就輔員的口語提示、紙本、圖片、聲音、影像等提示方法，以上這些提示方法所遇到的挑戰是無法即時確認學員是否確實執行該項工作，對於認知障礙者而言，要熟記複雜的工作步驟並同時確認步驟正確無誤，是一項挑戰。因此本研究以影像處理技術為基礎，開發出一套即時偵測的工作提示輔具，期望可以增進認知障礙者的工作效率並減輕就輔員的工作負擔。

關鍵字

影像處理 ； 工作提示 ； 語音辨識 ； 精神障礙

並列摘要

This research aimed to combine technology of image processing and speech recognition to assist people with cognitive impairment for food preparing; cognitive impairment is a kind of side effect by using drug treatment for mental illness, and by taking the medication will reduce the fine physical and cognitive ability to respond, thereby affecting the daily life and work performance. Therefore the subject of work prompting appear, work prompt means using some material like paper, picture to support their daily life and work. Till recent years, there’s some researchers start to use technology device like Personal Digital Assistant and combing multimedia material, although this kind of method do help people with cognitive impairment, but can’t auto detect whether people with cognitive impairment do their job correct, so still need social workers stand by their side. By the growing of computer industry, the field of image processing and speech recognition can be easily access, this research use speech recognition as cue to the system, and use image processing to check whether the user follow the cue to get the right thing. This study set the work field work project for pre vocational training. Finally, the research to verify the effectiveness of this system and pre-prepared meal feasibility assessment of training given to fine impaired future.

並列關鍵字

image processing ； speech recognition ； task prompting

參考文獻

[17] Sanjay Kr. Singh, D. S. Chauhan, Mayank Vatsa, Richa Singh, “A Robust Skin Color Based Face Detection Algorithm”, Tamkang Journal of Science and Engineering, Vol. 6, No. 4, pp. 227-234 (2003)

[10] Chien-Yu Lin, Chien-Chi Lin, Ci-Jie Chen, and Mei-Rong Huang, “Real-Time Interactive Teaching Materials for Students with Disabilities”, Future Communication, Computing, Control and Management, LNEE 142, pp. 369–375

[2] Kwvin Michael Ayres, Linda Mechling, Frank J. Sansosti.” The use of mobile technologies to assist with life skills/independence of students with moderate/severe intellectual disabilities and/or autism spectrum disorder: considerations for the future of school psychology”, Psychology in the Schools, Vol. 50(3), 2013

[3] Bouck E.C. (2012). Secondary students with moderate/severe intellectual disability: considerations of curriculum and post-school outcomes from the National Longitudinal Transition Study-2. Journal of Intellectual Disability Research. Retrieved January 22, 2012

[4] Mechling, Linda C., Gast, David L., Fields, Elizabeth A., (2008). Evaluation of a portable DVD player and system of least prompts to self-prompt cooking task completion by young adults with moderate intellectual disabilities. The Journal of Special Education, 42, 179-190.