應用於擴增實境白內障手術訓練系統之即時多器械追蹤技術

Real-Time Multiple-Instrument Tracking Technique for AR Cataract Surgery Simulation

張皓宇(Hao-Yu Chang)

指導教授 ： 歐陽明

國立臺灣大學/電機資訊學院/資訊工程學研究所/碩士(2017年)

https://doi.org/10.6342/NTU201701922

摘要

我們提供一套專門應用在擴增實境白內障手術模擬上的即時眼科手 術器械追蹤系統。這套系統可以追蹤常用於白內障手術的幾種器械， Spatular、Chopper 還有 Forceps。此外也可以同時追蹤多隻器械不互相 干擾。為了要能真實呈現手術時候視覺和手感，我們設計了一套獨有 的硬體架構配上演算法。這套系統包含兩台相機，經過我們深入了解 手術過程後，將兩台相機放置在特殊的位置使有最好的追蹤效果。我 們使用電腦視覺演算法，使得手術者在操作這系統時可以握住真實的 手術器械並自由操作不受限制。這套系統的解析度足以追蹤手術時的 精細動作。為了要呈現這套系統的能力，我們也開發了數個手術模擬 練習來呈現這套系統的能力。

關鍵字

擴增實境 ； 光學追蹤 ； 手術模擬

並列摘要

A real-time three-dimension eye surgery instruments tracking system is proposed for use with an Argumented Reality cataract surgery training system. Designed for cataract surgery, the system can track some of the main instruments, spatula, chopper, and forceps, and can track multiple instruments simultaneously. To simulate the real surgery in both visual and handling experience, we designed a new hardware structure and software algorithm. The system consists of two infrared cameras placed at the special position to track the position and orientation of the instruments. With computer vision based method, surgeons can move the instrument without any limitation. The system can perform high-resolution tracking and can detect all the delicate movement of surgeons. We design training tasks according to real cataract surgery process to demonstrate the potential of our system.

並列關鍵字

argumented reality ； optical tracking ； surgery simulation

參考文獻

[1] MSICS Virtual Reality Surgical Training Simulator. http://helpmesee.org/

[2] J. Chung, K. Yun, and H. Bang. Microtips: augmenting information for microscopic inspection. In ACM SIGGRAPH 2013 Emerging Technologies, page 10. ACM, 2013.

[4] Y.-H. Huang, W.-L. Yang, Y.-L. Kao, Y.-K. Chiu, Y.-B. Huang, H.-Y. Chang, and M. Ouhyoung. A novel dexterous instrument tracking system for augmented reality cataract surgery training system. In SIGGRAPH ASIA 2016 VR Showcase, page 14. ACM, 2016.

[5] I. W. Hunter, L. Jones, T. Doukoglou, S. Lafontaine, P. J. Hunter, and M. Sagar. Ophthalmic microsurgical robot and surgical simulator. In Photonics for Industrial Applications, pages 184–190. International Society for Optics and Photonics, 1995.

[7] S. Kitazawa, K. Sueda, and H. B.-L. Duh. Nanoar: mobile ar application with mi- croscopic interaction. In ACM SIGGRAPH 2012 Posters, page 73. ACM, 2012.