iConduct : Music control in the Interactive Conducting System

整合性音樂指揮互動系統

劉怡蘭(Yi-Lan Liu)

指導教授 ： 陳宜欣

國立清華大學/電機資訊學院/資訊系統與應用研究所/碩士(2009年)

摘要

Music conducting is the art of directing musical ensembles with hand gestures to personalize and diversify a music piece. The ability to successfully perform a music piece demands intense training and coordination of the conductor and the whole orchestra, but preparing a practice session is an expensive and time-consuming task. Accordingly, there is a need for alternatives to provide adequate training to conductors at all skill levels; virtual and augmented reality technology holds promise for this application. The goal of this research is to study the mechanics of music conducting and develop a system capable to closely simulate
the conducting experience. After extensive discussions with professional and nonprofessional conductors, as well as extensive research on music conducting materials, we identify several key features of conducting. A set of lightweight algorithms exploring those features are developed to enable tempo control, volume adjustment and instrument emphasis, which are core components of conducting. By using position/orientation sensors and data gloves as the interface for human-computer interaction, we develop a functional version of the system, iConduct. Evaluating the algorithms in real-world scenarios reveals the promising results; users of the final system express satisfaction with the virtual experience.

關鍵字

互動式指揮

並列摘要

多媒體和人機互動近年來蓬勃發展，在虛擬世界和真實生活中都有相當多的應用。但在音樂相關領域中，雖然互動式指揮系統有其市場需求和價值(例如：音樂教育及訓練、個人娛樂或應用於電影事業等等)，但過去的系統和研究都有著無法同時提供使用者音量、速度和分部等控制的限制。

此次的研究目標，是建立一個更接近真實樂團能力的互動式指揮系統。讓各種音樂背景的人，不僅能使用我們的系統來指揮樂曲的速度，還能針對整個樂團或特定樂器控制音量強弱起伏的變化。

根據實驗結果顯示，專業指揮者、業餘學生指揮和無指揮經驗的使用者皆能有效的進行互動式指揮。受測者亦對系統的使用滿意調查給予很好的評價。

參考文獻

[1] J. Borchers, E. Lee, W. Samminger, and M. M¨uhlh¨user. Personal orchestra: a real-time audio/video system for interactive conducting. Multimedia Syst., 9(6):594–594, 2004.

[2] J. O. Borchers, W. Samminger, and M. M¨uhlh¨auser. Engineering a realistic real-time conducting system for the audio/video rendering of a real orchestra. In MSE ’02: Proceedings of the Fourth IEEE International Symposium on Multimedia Software Engineering, page 352, Washington, DC, USA, 2002. IEEE Computer Society.

[3] S. H. A. Ericsson, K. A. Protocol Analysis: Verbal Reports As Data. MIT Press, Cambridge, MA, 1993.

[10] H. Morita, S. Hashimoto, and S. Ohteru. A computer music system that follows a human conductor. Computer, 24(7):44–53, 1991.

[11] D. Murphy, T. H. Andersen, and K. Jensen. Conducting audio files via computer vision. In Gesture Workshop, pages 529–540, 2003.