基於使用者回饋之個人化照片排序系統

Personalized Photograph Ranking and Selection System Considering Positive and Negative User Feedbacks

葉哲華(Che-Hua Yeh)

指導教授 ： 歐陽明

國立臺灣大學/電機資訊學院/資訊網路與多媒體研究所/博士(2012年)

https://doi.org/10.6342/NTU.2012.10283

摘要

在這個論文中，我們提出了一套個人化的照片評量系統。系統主要是跟據視覺上的美感自動對照片做評分和排序，除此之外，我們希望使用者可以自己定義何謂是美的照片。在使用上，我們希望是針對一般人所拍攝的照片作評量，而不是針對專業的攝影照片。
我們的系統會從照片中取出三種類別的特徵：構圖、顏色和光影、以及和個人喜好相關的特徵。之後利用RBF-ListNet演算法訓練出一個照片分數的預測模型，利用這個模型，我們可以預測照片的美感分數，進一步對照片做排序。為了讓使用者定義個人專屬的美感評量方式，我們提供三種使用者介面：Feature-based、Example-based、以及List-based方法。
在系統效果方面，我們的系統可以達到0.434的Kendall’s Tau值(排序關聯係數)，二元分類的準確率可以達到93%。我們也針對三種使用者介面做了使用者研究，結果顯示我們提出的三種介面都可以達到不錯的使用者經驗，尤其以example-based的效果最好。

關鍵字

照片排序 ； 照片美學 ； 個人化照片排序 ； 使用者介面

並列摘要

In this dissertation, we propose a novel personalized ranking system for amateur photographs. Our goal of automatically ranking photographs is not intended for award-wining professional photographs but for photographs taken
by amateurs, especially when individual preference is taken into account. Photographs are described using 20 image features which can be categorized into three types: photo composition, color and intensity distribution, and features for personal preferences. We adopt RBF-ListNet as the ranking algorithm. RBF-ListNet is based on an efficient algorithm, ListNet, using radial basis functions. The performance of our system is evaluated in terms of Kendall’s tau rank correlation coefficient, precision-recall diagram,
and binary classification accuracy. The Kendall’s tau value (0.434) is higher than those obtained by ListNet and support vector regression (SVR). The precision-recall diagram and binary classification accuracy (93%) is close to the best results to date for both overall system and individual features. To realize personalization in ranking, we propose three approaches: feature-based, example-based, and list-based approach. User studies indicate that all three approaches are effective in both aesthetic and personalized ranking. In particular, the example-based approach obtained the highest user experience rating among all three.

並列關鍵字

photo ranking ； photo assessment ； personalization ； photo selection ； aesthetic analysis

參考文獻

[26] F. Hoenig. Defining computational aesthetics. In Computational Aesthetics, pages

University of California, Berkeley, Feb 2009.

2010. ACM.

USA, 1933.

[4] B. E. Boser, I. M. Guyon, and V. N. Vapnik. A training algorithm for optimal margin