基於全局相似轉換的猜測之自然影像拼接

Natural Image Stitching with the Global Similarity Prior

陳育聖(Yu-Sheng Chen)

指導教授 ： 莊永裕

國立臺灣大學/電機資訊學院/資訊工程學研究所/碩士(2016年)

https://doi.org/10.6342/NTU201601069

摘要

此篇論文提出將多張影像盡可能自然拼接之方法，我們的方法是將影像鋪格子後使用局部的變形模型，而目標函式被設計成可用來決定變形模型的特性，像是影像對齊及最小化變形程度，除此之外，我們增加各影像之全局相似轉換的猜測至目標函式中，此猜測限制各影像之變形，使得各影像在整體上盡可能保留猜測之相似轉換，關於全局相似轉換的猜測對於拼接結果的自然度有至關重要的影響，我們提出一些方法選擇關於相似轉換中的縮放及旋轉之猜測。所有影像的變形模型將求解於最小化所有影像的整體變形，根據各個拼接結果顯示我們的方法皆優於目前幾項最先進的方法，包含 AutoStitch、APAP、SPHP 及 ANNAP。

關鍵字

影像拼接 ； 全景圖 ； 影像變形

並列摘要

This thesis proposes a method for stitching multiple images together so that the stitched image looks as natural as possible. Our method adopts the local warp model and guides the warping of each image with a grid mesh. An objective function is designed for specifying the desired characteristics of the warps. In addition to good alignment and minimal local distortion, we add a global similarity prior in the objective function. This prior constrains the warp of each image so that it resembles a similarity transformation as a whole. The selection of the similarity transformation is crucial to the naturalness of the results. We propose methods for selecting the proper scale and rotation for an image. The warps of all images are solved together for minimizing the distortion globally. A comprehensive evaluation shows that the proposed method consistently outperforms several state-of-the-art methods, including AutoStitch, APAP, SPHP and ANNAP.

並列關鍵字

image stitching ； panoramas ； image warping

參考文獻

[2] M. Brown and D. G. Lowe. Automatic panoramic image stitching using invariant features. Int. J. Comput. Vision, 74(1):59–73, Aug. 2007.

[3] R. Carroll, M. Agrawal, and A. Agarwala. Optimizing content-preserving projections for wide-angle images. ACM Transactions on Graphics, 28(3):43, 2009.

[4] C.-H. Chang, Y. Sato, and Y.-Y. Chuang. Shape-preserving half-projective warps for image stitching. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR ’14, pages 3254–3261, Washington, DC, USA, 2014. IEEE Computer Society.

[6] R. Grompone von Gioi, J. Jakubowicz, J.-M. Morel, and G. Randall. LSD: a Line Segment Detector. Image Processing On Line, 2:35–55, 2012.

[7] T. Igarashi and Y. Igarashi. Implementing as-rigid-as-possible shape manipulation and surface flattening. J. Graphics, GPU, & Game Tools, 14(1):17–30, 2009.