Multimodal Analysis of Image-Text Relations in an EFL Conversation Material

Shin-ying Huang

《Taiwan International ESP Journal》 10卷1期 (2019/04) Pp. 1-18

https://doi.org/10.6706/TIESPJ.201904_10(1).0001

摘要

While the multimodality of ELT textbooks has in recent years been increasingly studied for their pedagogic implications, unlike other genres of texts such as webpages, advertisements, picture books, and newspapers, textbooks have less often been viewed as semiotic artefacts, a perspective which leads to the study of image and text for intermodal interaction. To address this gap in the literature, this study explores visual and verbal interaction in ELT textbooks. In particular, the article focuses on the conversation section of an EFL senior high school textbook in Taiwan. The study found that the multimodal nature of face-to-face communication and the turn-taking mechanisms involved in conversations render the relations between images and texts unique in language learning materials. Consequently, frameworks of image-text relations that are developed based on narratives (such as picture books) or information texts are not sufficient for the understanding of this particular genre of multimodal text. This article discusses the distinct ways in which visual and verbal modes interact in multimodal ELT conversation texts and provides a preliminary framework for future examinations of language learning materials of a broader scope.

參考文獻

Teo, P., & Zhu, J. (2018). A multimodal analysis of affect and attitude education in China’s English textbooks. Multimodal Communication, 7(1). DOI: 10.1515/mc-2017-0014

Bezemer, J., & Kress, G. (2010). Changing text: A social semiotic analysis of textbooks. Design for Learning, 3(1-2), 10-29.

Babaii, E., & Sheikhi, M. (2018). Traces of neoliberalism in English teaching materials: A critical discourse analysis. Critical Discourse Studies, 15(3), 247-264.

Che, P. C. (2014). English Book 1 (Version B). Taipei, Taiwan: San Min.

Chen, Y. (2010a). Exploring dialogic engagement with readers in multimodal EFL textbooks in China. Visual Communication, 9(4), 485-506.