用於直接從二維魚眼影像估計三維人體姿勢的一種深度學習方法

在這份研究當中我們提出了一套基於深度學習的方法用來直接從二維魚眼影像估計人體關節在三維空間中的位置，這裡的二維魚眼影像是用一種以使用者自身為中心的視角去拍攝的。我們提出的方法之核心是一個基於Inception-v3所新設計的卷積類神經網路，特色是為魚眼影像調整而較大的卷積過濾器、訓練參數減量、長短期記憶、以及將擬人論的權重引入訓練網路時的損失函數。我們也進行了四類實驗來研究在該方法上使用不同訓練設定對測試結果的影響。這份研究的內容可以為發展出有著合理的資源使用量且更為複雜的電腦視覺深度學習網路提供經驗。

關鍵字

魚眼影像；三維人體姿勢估計；使用者自身為中心的視角；卷積類神經網路； Inception網路架構；長短期記憶； SELU激發函式；擬人論的權重

並列摘要

In this study, we propose a deep learning based method to directly estimate the human joint positions in 3D space from 2D fisheye images captured in an egocentric manner. The core of our method is a new design based on Inception-v3 convolutional neural network featuring the larger convolutional filter size, the reduction of parameters, the long short-term memory module, and the anthropomorphic weights on the training loss. We also conduct four groups of experiments to study the different effects upon the testing results when using different training settings of our work. The experience of our study can be helpful to develop more complicated deep learning network in a reasonable resource requirement to deal with the computer vision problems.

並列關鍵字

Fisheye Image ； 3D Human Pose Estimation ； Egocentric View ； Convolutional Neural Networks ； Inception ； LSTM ； SELU ； Anthropomorphic Weights

參考文獻

[1] M. Burenius, J. Sullivan, and S. Carlsson. 3d pictorial structures for multiple view articulated pose estimation. In CVPR, pages 3618–3625. IEEE Computer Society, 2013.

[4] M. Eichner, M. Marin-Jimenez, A. Zisserman, and V. Ferrari. 2d articulated human pose estimation and retrieval in (almost) unconstrained still images. International Journal of Computer Vision, 99:190–214, 2012.

[6] S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural Comput., 9(8):1735–1780, Nov. 1997.

[10] M. Loper, N. Mahmood, and M. J. Black. Mosh: Motion and shape capture from sparse markers. ACM Trans. Graph., 33(6):220:1–220:13, Nov. 2014.

[14] E. Shelhamer, J. Long, and T. Darrell. Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 39(4):640–651, Apr. 2017.

國際替代計量

用於直接從二維魚眼影像估計三維人體姿勢的一種深度學習方法

全文下載

主題瀏覽