以粒子群最佳化技術重建稠密式物體三維模型

Dense 3D Reconstruction with Particle Swam Optimization

宋秉一(Ping-Yi Sung)

指導教授 ： 陳稔

國立交通大學/資訊學院/多媒體工程研究所/碩士(2012年)

https://doi.org/10.6842/NCTU.2012.00786

摘要

本論文旨在利用Particle Swan Optimization的方式重建Multi-view Stereo多視角三維模型。本論文主要延伸patch based的expansion重建方式，分為幾大部分，分別為camera calibration、seed patch optimization、patch expansion、patch filtering，並且透過PSO來提供一個derivative free的解法。
本論文特色之一是延伸patch based的概念並改進在較sparse的camera view之下提供完整重建，主要使用geometric與texture matching兩個限制來定義較多且可靠的visible camera，並利用GLN-PSO local search的特性來進行有效率patch optimization與expansion。此外對於textureless的物體，我們使用multi-scale的pyramid image，相較於直接擴增patch size能夠提供更快的收斂速度。而對於非自然物的重建，我們則是利用adaptive fitness weighting來進行patch optimization，以獲得預期的銳利轉折處。

關鍵字

三維重建

並列摘要

This paper presents a stochastic optimization based multi-view stereo (MVS) approach for 3D dense reconstruction. We propose to apply adaptive weighted stereo matching functions to achieve more accurate optimization result. On the other hand, the reconstruction completeness falls short of the lack of enough visible views. We advocate allowing the child patch to borrow the parent visible view when needed even though the parent view is not in the specified viewing angle range. In addition, we shall adopt a GLN-PSO stochastic patch optimization method to avoid the local traps of a derivative based numerical optimization method. To improve the reconstruction quality we propose a patch priority queue to select the best patch to search for the next patch for the patch expansion process.

並列關鍵字

3D Patch-Based Reconstruction ； Multi-View Stereo ； GLN-PSO ； Patch Priority Queue ； Patch Expansion and Verification ； Patch Filtering

參考文獻

[1] S. Seitz, B. Curless, J. Diebel, D. Scharstein and R. Szeliski, "A comparison and evaluation of multi-view stereo reconstruction algorithms," Computer Vision and Pattern Recognition, vol. 1, pp. 519-528, 2006.

[4] J. Y. Chang, H. Park, I. K. Park, K. M. Lee and S. U. Lee, "GPU-friendly multi-view stereo reconstruction using surfel representation and graph cuts," Computer Vision and Image Understanding, vol. 115, pp. 620-634, May. 2011.

[5] G. Vogiatzis and C. Hernandez, "Video-based, real-time multi-view stereo," Image and Vision Computing, vol. 29, pp. 434-441, June. 2011.

[7] M. Habbecke and L. Kobbelt, "A Surface-Growing Approach to Multi-View Stereo Reconstruction," Computer Vision and Pattern Recognition, pp. 1-8, 2007.

[8] Y. Furukawa and J. Ponce, "Accurate, Dense, and Robust Multi-View Stereopsis," Pattern Analysis and Machine Intelligence, vol. 32, pp. 1362-1376, Aug. 2010.