- 學位論文
結合視訊與音訊特徵的自動廣告偵測技術
Automatic Commercial Detection Based on Joint Video and Audio Features
摘要
電視節目是由廣告和節目交替組合而成。雖然廣告對於廣告商和電視台是重要的資訊，但卻會降低觀眾觀賞節目的順暢度，因此廣告偵測具有許多應用的價值。本論文針對台灣的戲劇電視節目提出一個新的廣告偵測演算法，結合多項視訊與音訊特徵，以正確地辨識出節目內容開始或結束、和廣告開始或結束的時間點。本論文使用的視覺特徵包括停頓畫面、電視分級標誌和節目名稱，聽覺特徵為開始音樂、結束音樂和短暫無聲等。我們使用節目名稱比對、畫面相減、支持向量機、音訊短時距低能量比率、和音訊樣本的振幅等技術，分別偵測出節目名稱消失、停頓畫面、電視分級標誌、音樂片段、和無聲片段；再將停頓畫面、結束音樂和短暫無聲等特性互相搭配，決定節目內容結束和廣告開始的時間；最後將電視分級標誌、開始音樂和短暫無聲互相搭配，決定廣告結束和節目內容開始的時間。實驗結果顯示，本論文提出的方法可以偵測出測試影片中所有的廣告和節目內容片段，且其偵測的時間誤差大多低於1秒。
並列摘要
Broadcast TV programs intervene with commercials. Although commercials are important for advertiser and TV broadcasters, they will reduce the smoothness for watching TV programs. Detection of TV commercials is thus important for many applications. In this thesis, we propose a new TV commercial detection algorithm for drama programs in Taiwan. The proposed method integrates audio and video features to identify the starting and ending instants of program segments, and the starting and ending instants of commercial intervals. The employed visual characteristics include still pictures, rating logos, and program titles. The employed audio characteristics include the starting music, ending music, and short silence. We use program title comparison, frame difference, SVM (support vector machine), LSTER (low short-time energy ratio), and amplitudes of audio samples to detect the program title disappearing, still pictures, rating logos, starting music, ending music, and short silence. Then, we incorporate the information of still pictures, ending music, and short silence to decide the time instants of ending program segments and starting commercials. Finally, we use rating logos, starting music, and short silence segments to determine the time instants of ending commercials and starting program segments. Experiments show that the proposed method can detect all commercial intervals and the detected time instants are mostly within one second to the correct time instants.