整合資通訊輔助技術之盲用人機介面設計

The Integration of Information and Communication Assistive Technology in User Interface Design for the Visually Impaired

楊仲捷(Chung-Chieh Yang)

指導教授 ： 葉豐輝

淡江大學/工學院/機械與機電工程學系博士班/博士(2015年)

https://doi.org/10.6846/TKU.2015.00172

摘要

本研究目的在設計盲用人機介面與整合資通訊輔助技術來解決視障者在使用行動終端與固定終端裝置所遭遇到的問題。在行動終端上，本研究提出了虛擬鍵盤及手勢操作，以及虛擬點字鍵盤、中文點字多點觸控及手勢輸入方法，來協助視障者使用智慧型手機。所提出之設計方法被使用來整合語音合成、語音辨識、影像辨識、群眾外包等技術，實作出一個智慧型手機盲用APP，可在視覺、聽覺、閱讀與生活方面來輔助視障者。這個APP經過137位視障者測試，結果顯示88%以上的參與測試者可正確、順暢的操作與容易的學會使用。
在固定終端上，本研究提出了一個資通訊技術輔助盲用電話訪查系統，來協助視障者，可像明眼人一樣從事電話訪查的工作和建立更多元的就業機會。本研究使用ABAB設計與七位視障者來評估這個系統。測試的結果，他們在基線階段每月可成功電訪779通，介入階段每月可成功電訪3,070通。這樣的結果也顯示所設計的方法可有效的提升視障者工作效率。本研究之成果也透過APEC數位機位中心平台分享給菲律賓、馬來西亞與中國大陸。

關鍵字

點字 ； 視障者 ； 資通訊輔助技術 ； 人機介面

並列摘要

The objective of this study was to design user interface for the visually impaired and integrate information and communication assistive technology to solve the problems they encountered in using mobile terminal and fixed terminal device. In mobile terminal device, this study proposed virtual keyboard and gesture operating methods, Braille virtual keyboard, Chinese Braille multi-touch and gesture input methods to help visually impaired people use smart phone. The proposed design was used to integrate speech synthesis, speech recognition, image recognition, crowdsourcing technologies to implement a smart phone APP for the visually impaired. It can assist them in vision, hearing, reading and life. This APP was tested by 137 visually impaired people. The results showed that more than 88% participants can operate the APP correctly, smoothly, and learn to use it easily.
In fixed terminal device, this study proposed an information and communication technology assisted blind telephone interview system to help visually impaired people to do telephone interview jobs as normal sighted people and create more diverse employment opportunities. An ABAB design was used in this study to assess the system with seven visually impaired people. As the results, they can accomplish 779 effective telephone interviews per month in the baseline phase and 3,070 effective telephone interviews per month in the intervention phase. This results also showed that working performance of the visually impaired can be improved effectively with the proposed design. The results were also shared through the APEC Digital Opportunity Center platform to help visually impaired people in Philippines, Malaysia and China.

並列關鍵字

Braille ； Visually impaired ； Information and commutation assistive technology ； User interface

參考文獻

[14] F.H. Yeh, H.S. Tsay, S.H. Liang, “Applied CAD and ANFIS to the Chinese Braille Display Optimization,” Displays, Vol. 24, pp. 213-222, 2003.

[15] F.H. Yeh, H.S. Tsay, S.H. Liang, “Application of an Adaptive-Network-Based Fuzzy Inference System for the Optimal Design of a Chinese Braille Display,” Biomedical Engineering-Applications, Basis & Communications, Vol. 17, No. 1, pp. 50-60, 2005.

[17] T. McCarthy, J. Pal, E. Cutrell, “The voice has it: screen reader adoption and switching behavior among vision impaired persons in India,” Assistive Technology, Vol. 25, No. 4, pp. 222-229, 2013.

[18] G.E. Lancioni, M. O’Reilly, N. Singh, D. Oliva, “Enabling two women with blindness and additional disabilities to make phone calls independently via a computer-aided telephone system,” Developmental Neurorehabilitation, Vol. 14, No. 5, pp. 283-289, 2011.

[19] G.E. Lancioni, M.F. O'Reilly, N.N. Singh, J. Sigafoos, D. Oliva, G. Alberti, R. Lang, “Two adults with multiple disabilities use a computer-aided telephone system to make phone calls independently,” Research in Developmental Disabilities, Vol. 32, No. 6, pp. 2330-2335, 2011.