促進特殊幼兒之親子共讀的互動式娛樂科技

Developing Interactive Entertainment Technology to Promote Parent-Child Book Reading for the Children with Disabilities

吳岱衛(Tai-Wei Wu)

指導教授 ： 繆紹綱

中原大學/電機資訊學院/電子工程研究所/碩士(2017年)

https://doi.org/10.6840/cycu201700890

摘要

語言溝通能力是幼兒發展的一項重要指標，特別是對於特殊幼兒的父母，都希望知道如何能夠幫助自己的孩童，與孩童做更有效的互動，幫助其成長，因此就早期療育而言，父母的參與是非常重要的。眾所皆知，3C產品已經全面進入我們的生活中，而這也讓孩童使用3C產品的機會與日俱增，大大影響親子關係或是孩童身心的發展，因而如何讓3C產品在融入幼兒的生活中產生正面而非負面的影響也是一個重要課題。研究發現父母與孩童在使用3C產品時，宜採用親子「共讀、共視」的方式進行，親子共讀是利用故事作為媒介與親子成員共同進行閱讀，藉此建立親子間良好的雙向溝通與互動以及親子間彼此分享情感的方式，以增進親子關係並有利於幼兒在語言及認知潛能的發展。
本研究的目的是希望透過數位科技結合親子共讀的方式讓3C產品的使用能對於特殊幼兒在語言溝通能力與親子互動上有正面的影響。本研究將以眼動儀技術為基礎，開發出能夠偵測螢幕注視點的技術，並融入兒童故事繪本，且在配備攝影機的可攜式裝置上實現，以提升親子共讀時的互動性與趣味性，並藉此觀察孩童注意力是否集中及評估各種認知能力，促進孩童對童話故事的理解認知並提升親子互動的品質。
對於注視點估測技術，本研究採用非接觸式且以自然光源為基礎的異色邊界處理法，搭配人臉偵測技術取出眼部區域。接著透過本實驗室已獲專利的影像處理技術得到瞳孔影像位置，再估測出其注視在螢幕上的哪一個區域。接著是將注視點估測技術建立在行動裝置上，利用App透過雲端資料庫傳輸的技術，將注視點估測技術可以在行動裝置上發展，增加實用性與方便性。本研究的另一個重點是我們將這套系統運用在特殊教育領域上，形成了一個跨領域的結合。將注視點估測技術搭配說故事，利用類似床邊故事的方式，隨著故事的進行會出現幾個需要父母與特殊幼兒孩童合作完成的指令，以此方式來增進親子關係。
實驗結果顯示，我們的系統在瞳孔抓取上不管是注視著哪一個方向成功率都可以達到96%，在區分左右邊的成功率也可以到達95%以上，雖然將中間區域加入判定之後整體準確率降低不少，但是在區分左右邊的部分已經足以達到應用上的需求。在將我們的系統搭配現有的故事中在檢測孩童注意力方面也達到一定的水準，在親子互動性上家長也給予了正面的回應，另外透過記錄家長與孩童之間的互動，我們也發展了對於孩童語言能力的檢視。未來我們將再改良系統，希望可以提升在判定出三個不同區域時的精確度以及讓整體系統可以更加自動化增加操作上的方便性，接著結合兒童繪本故事建立出更完整的親子共讀系統，來達到增進特殊幼兒與父母間的親子關係的目的。

關鍵字

眼球注視 ； 異色邊界地帶 ； 注視點估測 ； 自閉症 ； 親子共讀

並列摘要

The ability of language communication is an important indicator of infant child development. The parents having disability children would especially like to know how to have more effective interaction with their children and help them grow. Therefore, the parent’s participation in early treatment of the children with disabilities is very important. As we all know, the products of computer, communication, and consumer electronics (3C) have fully occupy our life, which also increases the chance for the children to use a 3C product, resulting in significant impact on the parent-child relationship or physical and mental development of the children. Hence, how to let 3C products become a positive influence on children’s life instead of a negative one is also an important issue. Some study shows that when parents use 3C products with their child, it should be done in “co-reading and co-watching” manner by parents and their children. Given a story serving as a media, the parent-child co-reading is to let children and family members read the story together. In this way, one can establish a good two-way communication and interaction and the way to share the emotion between parents and children, which not only improves parent-child relationship but also promotes the development in language and cognitive potential for children.
The objective of this study is to have a positive impact on children with disabilities in language communication skills and interaction by the use of 3C products via digital technology along with parent-child co-reading. This study develops a technique to capture the gazing points on a screen based on eye-tracking technology. Assimilating into children picture books, the technique is implemented on a tablet computer equipped with a camera in order to promote interactivity and attract interests for parent-child co-reading. Furthermore, we can observe whether children pay attention or not and evaluate a variety of cognitive abilities. In this way, the comprehensive capability on fairy story for children can be enhanced and the quality of parent-child interaction can be improved.
For the techniques of gaze point estimation, this study uses a limbus tracking method, which is non-contact and nature light based. The method goes with face detection technology to find the eye region. Next, we capture the position of the pupil by using a special image processing technique that is patent awarded from our lab. Then we estimate which area on the screen is looked at. After that, the proposed eye gazing point estimation system is built on a mobile device as an APP. With cloud database transmission, the APP can increase the availability and convenience of the proposed system. Another important point of this study is that the proposed system is used in special education, resulting in cross-field integration. We combine gazing point estimation technology with the fairy story. The system runs in a way that is similar to telling a bedtime story. As the story goes, the system will prompt a few instructions to parents and child and they have to complete some tasks together and therefore improve the parent-child relation.
The experimental results show that the system can detect the pupil at about 96% of the time in four directions (looking left, right, up, and down). The success rate in distinguishing between the left and right areas on a screen can reach up to 95%. Although the overall success rate decreases when we add a middle area, the capability of distinguishing between just the left and the right screen areas has already met our current application demand. In combining of our system with the exiting story, the assessment of children’s attention also reached a certain level of success. The parents also gave us a positive response in parent-child interaction, and by recording the interaction between parents and their children, we developed the feasibility of examining children’s language ability. In the future, we will try to improve our system by increasing the success rate to distinguish three areas on the screen and making it more automatic and convenient. We also need to integrate the children’s picture books better to establish a more complete parent-child co-reading system in order to meet the objective of improving the relationship between parents and children with disabilities.

並列關鍵字

Eye gaze ； limbus-based approach ； gazing point estimation ； autism ； parent-child co-reading.

參考文獻

[17] 江知遠，以異色邊界地帶瞳孔追蹤處理法進行注視落點偵測，中原大學通訊工程碩士學位學程碩士論文，2013。

[34] 蔡東昇，基於眼球注視偵測技術的自閉症孩童早期快篩系統，中原大學電子工程研究所碩士論文，2016。

[1] 陳琪玲，親子共讀之語言溝通教學方案發展與執行之行動研究-以7位身心障礙幼兒及其家長為例，中原大學特殊教育研究所碩士論文，2008。

[15] 戴孟宗、林素淳、謝彥如、柯奏任，眼球追蹤研究與實驗，國立台灣藝術大學圖文傳播藝術學系，中華印刷科技年報，2008。

[2] 李玉惠，對兒童使用3C產品看法與態度之研究，學協會基金會學校行政103期，2016。