手語經驗對視覺空間心像運作影響之實驗研究

手語運用視覺空間特性呈現文法規則以達成語言溝通，本研究欲探討使用臺灣手語的使用者，相較於未有手語經驗的非手語者，是否在心像產生與心像維持運作上有所不同。本研究的心像實驗作業是以中文數字作提示，要求受試者於4×5方格中形成對應的阿拉伯數字心像，之後延宕一段時間（刺激間距ISI），於方格中的一個細格會出現一個目標項X，受試者需以按鍵判斷目標項位置是否出現在先前產生的心像路徑中。實驗操弄第一個受試者內獨變項為ISI，一組為心像產生（200、400毫秒），另一組為心像維持（800、2000毫秒）；第二個受試者內獨變項為目標項X出現在心像位置，依照筆劃順序先後分為早筆劃與晚筆劃位置，早晚筆畫差異可視為是心像完整性的指標，當有完整的心像時，早晚筆劃的差異便不復存在。實驗邀請24位失聰手語者、19位聽常手語者，與24位聽常非手語者參與，以澄清聽力、手語經驗與心像運作的關係。研究結果發現在心像產生ISI為400毫秒時，失聰手語者、聽常手語者早晚筆劃未有差異，顯示出手語使用者此時已產生完整的心像；在心像維持ISI為800毫秒時，失聰手語者與聽常手語者相較於聽常非手語者有較高的正確率，但在2000毫秒時則表現相似。基於上述結果以及失聰手語者與聽常手語者在心像運作的表現型態相似，本研究結果顯示出臺灣手語經驗與心像運作有關，手語經驗能促使手語者在心像產生與短期心像維持有其運作優勢，同時，手語和空間認知的相互作用關係可以提供更全面的觀點來了解語言如何塑造思想。

關鍵字

中文；心像產生；心像維持；手語；失聰／聾人

並列摘要

Purpose: In sign language, visual-spatial spaces are used to represent grammar rules to achieve language communication. This study examined whether the signers who had learned Taiwanese Sign Language (TSL) had different internal mental imagery processing than those who had no experience in sign languages. Methods: In this study, Chinese numerals were employed as probes in the experiment on internal mental images. The participants were required to form mental images corresponding to Arabic numbers in a 4 × 5 grid. After a period of delay (interstimulus interval [ISI]), a target X appeared in one of the grids. The participants had to determine whether the position of the target item appeared in the previously generated mental image path by pressing buttons. The first within-subject variable was ISI. One group of ISI was formed for image generation (200 and 400 ms) and the other group was formed for image maintenance (800 and 2000 ms). The second within-subject variable was the positioning of the target X in the mental image (early-imaged and late-imaged segments). The division of mental images into early-imaged and late-imaged segments was conducted according to the order of strokes in each mental image. Furthermore, on the basis of the assumption of the sequential process in image generation, the difference between early-imaged and late-imaged segments was considered an indicator of the integrity of the mental image. If the participants completed their mental images, the difference between early-imaged and late-imaged segments disappeared. The experiment recruited 24 deaf signers, 19 hearing signers, and 24 hearing nonsigners to clarify the impact of hearing loss and sign language abilities. Results/Findings: The results highlighted that during the image generation with ISI 200 ms, all participants demonstrated superior performance in the early-imaged segment condition. During the image generation with ISI 400 ms, the nonsigners still showed the effects of early-imaged and late-imaged segments. However, no differences were observed among signers in the early-imaged and late-imaged segments. This findings indicated that the signers had already produced a complete mental image by that time. When the mental image was maintained for 800 ms in the image maintenance task, the signers had a higher accuracy than the hearing nonsigners. However, the signers and nonsigners performed similarly when ISI 2000 ms was employed. The deaf signers and the hearing signers demonstrated similar performance patterns in both image tasks, highlighting the critical role played by experience in TSL. Conclusions/Implications: Our findings revealed that experience in sign language proved advantageous for signers in terms of mental image generation and short-term mental image maintenance. The interaction of sign languages and spatial cognition could offer a more comprehensive view of how language shapes the mind.

並列關鍵字

Chinese characters ； hearing impaired/deaf ； image generation ； image maintenance ； signed languages

參考文獻

劉秀丹、劉俊榮、曾進興、張榮興（2015）：臺灣手語理解能力標準化測驗的編製與發展。特殊教育研究學刊，40（3），27-57。[Liu, Hsiu-Tan, Liu, Chun-Jung, Tseng, Chin-Hsing, & Chang, Tung-Hsing (2015). Development of a standardized Taiwanese Sign Language comprehension test. Bulletin of Special Education, 40(3), 27-57.] https://doi.org/10.6172/BSE.201511.4003002

Emmorey, K., Klima, E., & Hickok, G. (1998). Mental rotation within linguistic and nonlinguistic domains in users of American sign language. Cognition, 68(3), 221-246. https://doi.org/10.1016/S0010-0277(98)00054-7

Emmorey, K., & Kosslyn, S. M. (1996). Enhanced image generation abilities in deaf signers: A right hemisphere effect. Brain and Cognition, 32(1), 28-44. https://doi.org/10.1006/brcg.1996.0056

Emmorey, K., Kosslyn, S. M., & Bellugi, U. (1993). Visual imagery and visual-spatial language: Enhanced imagery abilities in deaf and hearing ASL signers. Cognition, 46(2), 139-181. https://doi.org/10.1016/0010-0277(93)90017-P

Emmorey, K., Luk, G., Pyers, J. E., & Bialystok, E. (2008). The source of enhanced cognitive control in bilinguals: Evidence from bimodal bilinguals. Psychological Science, 19(12), 1201-1206. https://doi.org/10.1111/j.1467-9280.2008.02224.x

國際替代計量

手語經驗對視覺空間心像運作影響之實驗研究

全文下載

主題瀏覽