基於電腦視覺技術發展籃球競賽之球員狀態數據獲取系統

Developing Player Status Data Acquisition System in Basketball Competition based on Computer Vision Technology

黃博揚(Huang, Bo Yang)

指導教授 ： 蔡宏營

國立清華大學/工學院/動力機械工程學系/碩士(2016年)

摘要

本研究藉由電腦視覺技術發展一套應用於籃球競賽之球員狀態數據獲取系統，此系統具有以下幾個主要功能：(1) 球員追蹤：利用人物偵測與視覺追蹤技術將每個時間點球員在場上的位置記錄下來；(2) 球員運動軌跡圖：將追蹤技術獲得不同時間點的球員位置映射到球場模型圖上，讓使用者更清楚的了解球員在場上的運動狀況；(3) 球員表現之數據呈現：統計視覺追蹤技術與姿態辨識所獲得的球員資料，並將其呈現出來供使用者做進一步的應用或分析。
本研究使用三台攝影機架設在籃球場外的三個位置，以固定視角的方式錄下比賽。將此三個不同視角的影片輸入置系統後，利用Faster R-CNN進行人物位置偵測與動作辨識，以HSV特徵與K-近鄰算法(K-Nearest Neighbor, KNN)分類器將偵測到的人物分成隊伍A、隊伍B的球員以及裁判，並使用單應性矩陣(Homography matrix)把球員位置映射到籃球場模型圖上，透過匈牙利配對演算法(Hungarian Algorithm)與卡爾曼濾波器(Kalman Filter)對場上的10位球員進行追蹤，由Faster R-CNN的動作分類結果判別各個球員於每個時間點的動作，最後將記錄到的球員位置、動作進行統計及量化數據的呈現給使用者。

關鍵字

人物偵測 ； 人物動作辨識 ； 籃球球員追蹤 ； 籃球球員數據分析

並列摘要

This study develops a player status data acquisition system in basketball competition by using computer vision technology. This system has the following functions: (1) Player tracking: Player position which is obtained by human detection and object tracking technology is recorded in each frame; (2) Player trajectory map: Player movement trajectory will be project into the basketball court model to allow user to understand player movement status; (3) Player status data display: the player status data which is gained by player tracking and action detection will be shown for user to use in more application or analysis.
In this study, three cameras are set up at three locations outside the basketball court, recording the basketball game with fixed view. While loading these three videos into the system, Faster R-CNN will detect human position and recognize action. In order to know who is player, HSV feature will be extracted from the human images and be input to KNN classifier to classify into team A, team B and referee. And then, player position will be projected by using Homography matrix to basketball court model. Ten players on the court are tracked by utilizing Kalman filter and Hungarian algorithm. Afterward, player status data which is calculated from player position and player action will be display for user.

並列關鍵字

human detection ； human action recognition ； basketball player tracking ； player status data analysis

參考文獻

[2] D. M. Gavrila and V. Philomin. “Real-Time Object Detection for Smart Vehicles.” The Proceedings of the Seventh IEEE International Conference on Computer Vision and Pattern Recognition, Vol.1, pp.87-93, 1999.

[3] D. M. Gavrila. “Pedestrian Detection from a Moving Vehicle.” The Proceedings of the sixth European Conference on Computer Vision, pp. 37-49, 2000.

[4] P. Viola and M. J. Jones. “Robust Real-Time Face Detection.” International Journal of Computer Vision, Vol. 52, No. 2, pp. 137-154, 2004.

[5] P. Viola and M. J. Jones. “Detecting Pedestrians Using Patterns of Motion and Appearance.” International Journal of Computer Vision, Vol. 63, No. 2, pp. 153-161, 2005.

[6] N. Dalal and B. Triggs. “Histograms of Oriented Gradients for Human Detection.” Proceedings IEEE International Conference on Computer Vision and pattern Recognition, Vol.1, pp. 886-893, 2005.