- 期刊
消失與復現──音樂與聲音在圖畫書中的視覺化
Disappear and reappear: The visualization of music and sound in picture books
摘要
圖畫書在成為圖畫書之前，其實是街頭上的看圖說演，這是圖畫書的史前史狀態：有大型掛畫、說書者和樂器（手搖風琴、小提琴）演奏的型態。在進入視覺轉向和書面文化時代後，說書者式微，尤其是音樂消逝了。同時期的童謠傳唱，在進入書面時代後，也遭遇相同困境：最初是以樂譜的型態進入書面冊頁，旁邊則圍繞著插畫家們越來越生動的圖像敘事。而後一個重要關鍵改變發生：樂譜全然消失了，只留下無主的歌詞。這些簡短充滿空隙的童謠歌詞，讓畫家，比如凱迪克（Randolph Caldecott）有了極大發揮圖像敘事的空間。這也是為什麼凱迪克的作品都是以童謠歌詞為「故事」的緣故。現代的圖畫書的創立其實就建立在音樂的消逝上面。音樂自此隱匿，要到近一個世紀後，二十世紀80年代才以兩種方式復現：第一種，是樂譜再度出現，是採取與文字作者和畫者一起合作的全新方式呈現。第二種，是藉著二十世紀初的繪畫革新，如抽象繪畫，音樂改以純粹視覺造型形式呈現。這方式也給出新的型態：一種給眼睛聆聽的音樂。此一發展在視覺時代日益盛行，插畫家也藉由音樂開展出新的視覺語言。擬聲詞和聲音也有相類似的發展，也隨著前述歷程給出嶄新呈現。有趣的是，這也帶動了口語的復甦，口語傳統其實也和音樂一樣，在進入書面時代後衰微，現在透過色彩與造型的視覺化閱讀，得以在字詞的彩色造型中復聲，自然也是全新的口語經驗。最後在二十一世紀，藉由前此數學（傅立葉轉換）和數位技術的協助下，圖畫書與音樂和口語傳統得以以跨領域的結合型態呈現。
並列摘要
Before the picture book became a picture book, it was actually a picture-telling show on the street. This is the prehistoric state of the picture book: there are large-scale hanging pictures, storytellers and musical instruments (hand organ, violin) playing. After the visual turn and the era of written culture, the storyteller and, above all, the music. The singing of nursery rhymes in the same period also encountered the same dilemma after entering the written era: at first, it entered the written album in the form of musical scores, and it was surrounded by the increasingly vivid image narratives of illustrators. And then an important key change happened: the music score disappeared completely, leaving only the lyrics without owner. These short nursery rhyme lyrics full of gaps allow painters, such as Randolph Caldecott, to have a lot of room to develop image narratives. This is why Caldecott's works all use the lyrics of nursery rhymes as "stories". The creation of modern picture books is actually based on the disappearance of music. Music has been hidden since then, and it was not until nearly a century later that it reappeared in two ways in the 1980s: the first is the reappearance of the score, which is presented in a new way in cooperation with the writer of words and the painter. The second is to use the innovations in painting in the early 20th century, such as abstract painting, to present music in a purely visual form. This approach also gives a new form: a kind of music for the eyes to listen to. This development is increasingly prevalent in the visual age, where illustrators develop a new visual language through music. Interestingly, this has also led to the revival of spoken language. Onomatopoeia and sound also have a similar development, and also give a new presentation along with the aforementioned process. In fact, the oral tradition, like music, has declined after entering the written era. Now, through the visual reading of colors and shapes, it is possible to echo in the colorful shapes of words. A new oral experience. Finally, in the twenty-first century, with the help of previous mathematics (Fourier transform) and digital technology, picture books and musical and oral traditions can be presented in a cross-disciplinary combination.