結合互動電子媒材與電腦視覺技術於文物互動展示之研究

The research of Combining Interactive Electrical Materials and Computer Vision Technology for Interactive Exhibition of Cultural Artifacts

陳銘祥(Ming-Hsiang Chen)

指導教授 ： 王照明

共同指導教授 ： 劉如生(Ru-Sheng Liu)

元智大學/資訊學院/資訊工程學系/碩士(2008年)

摘要

互動展示漸漸成為博物館或各種商業展覽的未來發展方向，從以往的靜態參觀及文字說明變成了互動式的展覽。大多數相關的研究，將文物設計成一套互動遊戲，以加深參觀者對該文物的印象，本研究則是以文物本身為主角，分析文物的操作方式及使用情境，設計一套該文物專屬虛擬實境互動系統，不但加深參觀者對文物的印象，更能進一步的讓參觀者認識該文物與古代生活互動的內涵。
本研究提出藉由分析文物的分類、用途、使用方法及操作方式，選用適合的電子媒材及運用電腦視覺技術模擬出使用該文物的操作情境，並實際設計出兩套文物數位互動展示系統。
第一套系統以中國古代打擊樂器為例，本研究設計出一套編鐘與鼓的數位互動展示系統，模擬戰國時期君王命人演奏編鐘與鼓的壯闊場面；本系統以紅外線LED裝置，透過Webcam捕捉LED位置，讓真實世界參觀者的視點與虛擬世界攝影機視點融為一體，虛擬世界的場景隨著參觀者頭部的擺動而即時改變，令參觀者彷彿置身於虛擬世界中，不同於傳統需使用VR眼鏡才能感受置身於虛擬世界中，因此不會令參觀者有頭暈之現象，並且使用Wiimote配合紅外線開關，偵測參觀者敲擊編鐘的節拍、音階與力道，動態回應鐘鼓聲的節奏、音階與音量，此系統透過視覺、聽覺與觸覺，讓參觀者體驗真實編鐘在古代的演奏情境。
第二套系統以國畫為題材，本研究將以畫竹為例，讓參觀大眾只要畫出竹桿後，其餘的竹枝、竹葉均由系統自動產生，透過簡單的參與就能感受古代文人畫竹的過程。本系統將運用一系列電腦視覺演算法，找出竹子中的竹節，再進行竹枝、竹葉之合成，是一套融合畫竹情境之互動展示系統。
經由實驗結果證明，本研究所提出的文物使用情境融入數位互動展示系統確實可行，已達到加深參觀者對文物了解之目的。

關鍵字

人機互動 ； 虛擬實境 ； 電子媒材 ； 電腦視覺

並列摘要

The way of interactive exhibition, from the static and literal display to the interactive presentation, is getting more and more popular for the museum and trade show in the future. The most related research is used to design the cultural artifacts as interactive games, by this way the visitor can be deeply impressed. However, this research is focus on the cultural artifacts themselves. By analyzing the operation and usage scenario of the cultural artifacts, we can design an exclusive virtual reality interaction system for the cultural artifacts. Not only can it impress visitors, but it can make visitors realize further the essence of the connection between the artifacts and the ancient lifestyle.
By analyzing the category, functionality and usage way of the cultural artifacts, this research proposes that we can use some suitable electrical materials and the computer vision technology to simulate the operation scenario of the cultural artifacts and we implement two sets of digital artifacts interaction systems.
The first interactive exhibition system is based on the example of the Chinese ancient percussion instrument. This research designs a set of digital interactive exhibition system for the chime and drum to simulate the pageant that bell ringer to perform the chime and drum order by the king of the Warring States. This system will capture the sight point of the visitor continuously by passing infrared LED light through the Webcam. By making the sight point of user consist with that the cam of virtual world, the scene of the virtual reality system will be changed as the visitor move his head simultaneously. This effect, far from those traditional ways in wearing the VR eyeglasses which make people dazzle, can make the visitor feel real in the virtual world without that VR eyeglasses. Second, by using the Wiimote and the infrared switch, the system can detect the rhythm, strength and the tendency when the visitor raps the chime and return the rhythm, tone and volume of the drumbeat simultaneously. The visitor can experiences the performance of the real chime in ancient time by through his vision, hearing and touch.
The second interactive exhibition system is based on the subject of the traditional Chinese painting which is the essence of the Chinese culture.This research takes bamboo painting as example. The visitor can draw the trunk of the bamboo on the system and then the branch and leaf of the bamboo will be generated automatically. By this way the visitor can image the process of the bamboo painting what the ancient did. This system adopts a serial algorithm of computer vision to find the segment of the bamboo and then join that specific segment with the branch and leaf.
By examining the experimental result, this research has proved that the digital interactive exhibition system which applied to usage scenario is truly feasible. It also achieves the goal of making the visitor deeply realize the cultural artifacts.

並列關鍵字

Human-Computer Interaction ； Virtual Reality ； Electrical Materials ； Computer Vision

參考文獻

[18]羅啟宏，“應用在視訊檢索之智慧型人臉偵測系統”，元智大學資訊工程學系碩士論文，民國九十五年。

[3] 易斌，“虛擬設計博物館之互動導覽設計”，國立成功大學工業設計研究所碩士論文，民國九十二年。

[4] 林國棟，“運用實體介面於互動展示之研究-以中國文物為例”，元智大學資訊傳播系碩士班數位媒體設計組碩士論文，民國九十五年。

[5] 柯翰庭，“應用擴充現實技術於配置設計之視覺化”，國立成功大學工業設計研究所碩士論文，民國九十一年。

[12]黃自達，“以相機取像之中文文件辨識前處理系統”，國立中央大學資訊工程研究所碩士論文，民國九十六年。