使用轉角偵測與虛擬網格法重建三維模型

3D Object Model Recovery from 2D Images Utilizing Corner Detection and Virtual Mesh Grid

黃盈源(Ying-Yuan Huang)

指導教授 ： 陳美勇

國立臺灣師範大學/科技學院/機電科技研究所/碩士(2011年)

摘要

本研究主要之研究目標為使用二維影像重建三維物件模型。一般研究上所使用的方法為非接觸式系統中的立體視覺法，此方法模擬人類雙眼感知影像進而推算物體與雙眼間之深度，因此系統需要使用兩隻攝影機進行影像的擷取，擷取後的兩張影像進行匹配找出現實空間中一點分別投影至二維影像的投影點，之後利用現實空間與相機座標系統彼此間的幾何轉換關係，藉由兩張影像上的投影點計算出此一點於現實空間中之深度資訊，如此一來即可重建出物體的三維模型。然而立體視覺法中困難之處在於如何從左右兩影像準確地找出相對應的投影點進行深度計算，因此針對此問題在過去的研究提出從外部投影一結構光至物件表面，藉由結構光協助系統定位左右兩影像中相對應的投影點，然而此法受限於物體表面之顏色。故本研究提出之三維重建方法無須藉由投影結構光即可重建出物件之三維模型，針對簡單幾何物件以及曲面物件分別使用轉角偵測以及虛擬網格協助系統定義左右兩影像中相對應的投影點重建出物件之三維模型，簡單幾何物件之特徵點通常出現於輪廓之轉角處，因此系統透過轉角偵測找出左右兩影像中物件輪廓之特徵點，藉由立體視覺法重建起特徵點之深度資訊將特徵點重建至三維座標空間中，再根據重建之特徵點還原出物件之三維模型。在另一方面，由於曲面物件不同於簡單幾何物件在轉角處有明顯之特徵點，因此本研究先於左物件影像建立起虛擬網格，藉由極線幾何原理估測曲面物件左右兩影像中相對應的投影點，於右物件影像建立起相對應的虛擬網格，根據左右兩物件影像之虛擬網格以立體視覺法成功地重建出曲面物件之三維模型。

關鍵字

三維重建 ； 立體視覺法 ； 轉角偵測 ； 虛擬網格

並列摘要

This research proposes a new method to reconstruct the 3D object model from 2D images. One type of the non-contact scanning measurement for the stereo vision algorithm is used in this research. The stereo vision simulates human’s eyes to capture the depth information of the object. Therefore, this research uses two CCD Cameras to capture two images of the object. Then, find out the match points from the two images. Using the match points and combine 1)the parameters of the two CCD Cameras and 2)transform matrix between the world coordinate and camera coordinate to get the depth information of each point in the space. Finally, the object’s 3D model can be reconstructed. The important issue of the stereo vision theorem is how to find out the match points from the two images accurate. For solving this issue in the past researches, many articles used a projected structure light on the object’s surfaces to measure the match points. In this research, the proposed system is able to find out the match points from the two images by the structure light. But this method will be restricted by the color of the object surface. This research proposes a method to reconstruct the 3D model without projecting the structure light. The system uses corner detection and virtual mesh grid to reconstruct the simple geometry and curved the surface of object. The feature points of the simple geometry object are usually on the corner of the contour. So we can find out the feature points by doing the corner detection, and then the system would calculate the depth of the feature points to project the feature points in the 3D coordinated space. And then, the simple geometry object’s 3D model would be reconstructed from these feature points. But the curved surface object doesn’t have the visible feature points, therefore, this paper build up the virtual mesh grid from the left image. Then, the system would estimate the match points by the epipolar geometry theorem and builds up the virtual mesh grid on the right image. Finally system reconstructs the 3D model by the stereo vision theorem and virtual mesh grid of the two images successfully.

並列關鍵字

3D reconstruction ； Stereo vision ； Corner detection ； Virtual mesh grid

參考文獻

[1] Q. Zhao, D. Zhang, L. Zhang and N. Luo, “High resolution partial fingerprint alignment using pore–valley descriptors,” Pattern Recognition, vol. 43, pp. 1050-1061, March 2010.

[2] C. N. E. Anagnostopoulos, V. Loumos and E. Kayafas, “License Plate Recognition From Still Images and Video Sequences: A Survey,” IEEE, Transactions on Intelligent Transportation Systems, vol. 9, pp. 377-391, September 2008.

[3] J. Y. Choi, Y. M. Ro and K. N. Plataniotis,“Boosting Color Feature Selection for Color Face Recognition,”IEEE, Transactions on Image Processing, vol. 20, pp. 1425-1434, May 2011.

[4] W. Wei, G. Wang and H. Chen, “3D reconstruction of a femur shaft using a model and two 2D X-ray images, ” IEEE, International Conference on Computer Science & Education, pp. 720-722, 2009.

[5] P. Gamage, S. Q. Xie , P. Delmas, P. Xu, “ 3D reconstruction of patient specific bone models from 2D radiographs for image guided orthopedic surgery, ” IEEE, 2009 Digital Image Computing: Techniques and Applications, pp. 212 – 216, 2009.