從多組旅遊照片中建構出代表性的照片集

A study on constructing a representative photo stream from multiple sequences of travel photos

鄭宇辰(Yu-Chen Cheng)

指導教授 ： 葉梅珍

國立臺灣師範大學/理學院/資訊工程研究所/碩士(2011年)

摘要

在本論文中，我們提出一個自動的方法有效的對照片進行管理，目標是從一起出遊的朋友們所拍攝的多組旅遊照片中建構出代表性的照片集，而這類型照片的特性是彼此間會有很高的相似度。首先，我們提出一個基於生物資訊學上比對基因序列之間相似度的演算法，並將其應用在相似照片序列的比對上。接著利用比對的結果將兩組不同的照片序列進行有效的合併。接著，我們進一步的提出一個照片評分方法，對合併後的照片序列進行評分的工作，最後保留分數較高的照片來當做代表性的照片集。有別於以往對照片評分的方法，皆是對單一照片直接進行評分的工作，我們則是利用了相似場景中其它相似的照片來輔助對單一照片的評分。在實驗上，我們收集了22個使用者所拍攝的照片來驗證我們所提出的方法。

關鍵字

照片序列比對 ； 照片評分

並列摘要

In this paper, we develop automatic approaches for effectively managing photos. In particular, we aim to find a representative stream of travel photos taken with friends in the same trip. One characteristic of such photos is that they tend to share similar contents despite the fact that they are taken by different people. Based on the observation, we first propose a method to combine multiple photo sequences into a photo stream. It is inspired by sequence alignment techniques in bioinformatics for finding similar DNA and protein sequences. Next, we develop an aesthetic quality assessment method to score each photo. Photos with higher scores are retained and formed the representative photo stream. Unlike conventional approaches that solely use information within the photo under evaluation, we show that information of the near duplicate images—which are mostly available in travel photos—could be used to facilitate the quality assessment problem. Experimental results using travel photos collected from 22 users validate the effectiveness of proposed approaches.

並列關鍵字

photo sequence alignment ； photo quality assessment

參考文獻

[1] S. Bhattacharya, R. Sukthankar, and M. Shah. A framework for photo-quality assessment and enhancement based on visual aesthetics. In Proceedings of the ACM international conference on Multimedia, pages 271–280, 2010.

[2] W.T. Chu and C.H. Lin. Automatic selection of representative photo and smart thumbnailing using near-duplicate detection. In Proceeding of the 16th ACM international conference on Multimedia, pages 829–832, 2008.

[4] F. Crete, T. Dolmiere, P. Ladret, and M. Nicolas. The blur effect: perception and estimation with a new no-reference perceptual blur metric. Human Vision and Electronic Imaging XII, 6492:11.

[5] R. Datta, D. Joshi, J. Li, and J. Wang. Studying aesthetics in photographic images using a computational approach. Proceedings of the European Confer- ence on Computer Vision, pages 7–13, 2006.

[7] D. Hoiem, A.A. Efros, and M. Hebert. Recovering surface layout from an image. International Journal of Computer Vision, 75(1):151–172, 2007.