透過您的圖書館登入
IP:3.15.6.77
  • 學位論文

一個以視訊為基礎的多重互動學習平台

A Video-based Learning Platform with Multimodal Interactions

指導教授 : 許輝煌

摘要


互動式視訊可以為使用者帶來不同的瀏覽經驗。藉由相關技術,視訊可以被強化以吸引學生的注意。本論文中提出了一個互動式視訊的課程平台,課程提供者可以藉由課程編輯程式來製作互動式的視訊課程。視訊會被切割成較小的片段並且加入互動物件及多媒體資訊以強化課程的多樣性。使用者可以利用撥放程式來存取互動式視訊以及透過互動來獲得課程中的多媒體資訊。 多種裝置被應用在於擷取使用者的互動。鍵盤、滑鼠、遙控器及網路攝影機都是本論文所提出系統採用的輸入裝置。鍵盤滑鼠可用於一般的電腦環境,使用者可以操作課程編輯系統及播放程式而無須再適應。另一個整合遙控器的子程式則是用來模擬使用者觀看電視的行為。網路攝影機用來擷取使用者的手勢以提供更直覺化的互動方式。相關的數位電視技術亦被採用以發展以數位電視為基礎的互動平台。 藉由整合全球定位系統元件到本論文提出之系統,學生可以在不同地點獲得相關的資訊。特定場所會呈現出不同的多媒體資訊。事先設定好的活動、事件以及介紹等,都會以多媒體的方式呈現給學生。

並列摘要


Interactive video was developed to enable different video experiences to users. With related technologies, video materials can be augmented to attract students. An interactive video course platform integrated with location information is proposed in this dissertation. Content providers can produce interactive video courses by using the interactive video authoring tool. Video files will be cut into several smaller segments called scenes as the basic unit in a video course. Interactive objects and multimedia resources can also be inserted to video courses to enhance variety. Users can play interactive video via the proposed playback platform. Interactions, messages and other multimedia objects will be displayed in scenes when users browse video courses. Multiple devices are used for capturing users’ interactions. Keyboard, mouse, remote control and web camera are used as input devices in the proposed system. Keyboard and mouse are used in ordinary computer environment; users can operate the authoring tool and playback system as other programs on personal computers. A proposed sub application simulates the behavior of users watching TV programs with remote control. Web camera captures gestures of users to provide intuitional interactions. Specifications of digital TV technologies like DVB and MHP are also used for implementing a platform for evaluating user’s learning performance on TV. By integrating with global positioning system component to this proposed system, students can have experience of taking information in different locations. Multimedia information will be presented in specified locations. With users’ location information, arranged activities, events and introduction will be presented to students in multimedia forms.

參考文獻


[2]. Hada, Y., Ogata, H., and Yano, Y., “XML-based Video Annotation system for Language Learning Environment,” in Proceedings of the Second International Conference on Web Information Systems Engineering, Vol. 1, Dec. 3-6, 2001.
[3]. Sawhney, N., Balcom, D. and Smith, I., “Authoring and navigating video in space and time,” in IEEE Multimedia, Volume 4, Issue 4, Oct.-Dec. 1997.
[4]. Correia, P.L. and Pereira, F., “Objective evaluation of video segmentation quality,” in IEEE Transactions on Image Processing, Vol. 12, Issue 2, Feb. 2003.
[5]. Oka, K., Sato, Y., and Koike, H., “Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems,” in Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, May 20-21, 2002
[6]. Yang L. and Yunde J., “A robust hand tracking and gesture recognition method for wearablevisual interfaces and its applications,” in Proceedings of the Third International Conference on Image and Graphics, Dec. 18-20, 2004.

延伸閱讀