精化多視角影像密匹配及點雲產製

Refinement of Multi-view Dense Image Matching and Point Cloud Generation

劉宣萱(Hsuan-Hsuan Liu) ； 趙鍵哲(Jen-Jer Jaw)

《航測及遙測學刊》 26卷2期 (2021/06) Pp. 75-94

https://doi.org/10.6574/JPRS.202106_26(2).0002

摘要

大量多視角影像於密匹配計算處理上較為複雜而繁瑣，且針對每一像對分別計算其初始視差值，耗損的時間成本亦相對增加；再者，具多組像對重疊條件之多視角影像，倘未善加調製其交會幾何，產製之場景點雲即便具有描述幾何多餘觀測特性，然而點位的不精確性以及較大的離散度亦無助於後續空間資訊之應用。對此，本研究提出一系列優化作業模式並區分為三大主軸：建立影像群聚關係、視差傳遞策略和點雲精化策略等。業經兩組實際資料驗證其功效及可行性，說明所研擬方法產製之點雲能有效描述場景幾何，且於兩測試區域之像對計算總量部分，減少約為44％及14％，而針對其時效提升部分則達80％以上。

關鍵字

影像密匹配 ； 多視角 ； 點雲 ； 精化

並列摘要

Processing large number of multi-view images is complicated and tedious. Also, when matching multiple stereo pairs, it would take long in getting disparity values if each pair is to be processed independently. In addition, redundantly described scene models with low reliability trouble the exploitation of geospatial information. This paper proposes an effective matching strategy featuring in key view selection and clustering, disparity delivery and point cloud refinement to tackle the aforementioned shortcomings. The proposed approach has been tested by two practical data sets and it is proven that both the efficient image manipulation with the computational time reduction more than 80% and quality point cloud generation well depicting the scene geometry highlight the merit of this study.

並列關鍵字

Dense Image Matching ； Multi-view ； Point Cloud ； Refinement

參考文獻

丁皓偉 H.W., H.W.(2014).結合十字區塊匹配之半全域匹配法優化作業.國立臺灣大學土木工程學系=National Taiwan University.

李欣錡 H.C., H.C.(2016).結合邊緣特徵資訊之半全域匹配法.國立臺灣大學土木工程學系=National Taiwan University.

Ahmadabadian, A.H.,Robson, S.,Boehm, J.,Shortis, M.(2013).Image selection in photogrammetric multi-view stereo methods for metric and complete 3D reconstruction.Proceedings of the SPIE Vol.8791, Videometrics, Range Imaging, and Applications XII; and Automated Visual Inspection.(Proceedings of the SPIE Vol.8791, Videometrics, Range Imaging, and Applications XII; and Automated Visual Inspection).:

Hirschmüller, H.(2005).Accurate and efficient stereo processing by semi-global matching and mutual information.Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.(Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition).:

Hirschmüller, H.(2008).Stereo processing by semiglobal matching and mutual information.IEEE Transactions on Pattern Analysis and Machine Intelligence.30(2),328-341.