穿戴式手勢辨識裝置應用於智慧家庭之研究

WES是一個使用穿戴式裝置控制家電的系統，它由三大部分組成：WES控制器、WES接收器，以及電器控制器。WES使用套在食指上類似戒指的裝置，透過三軸加速計的信號，辨識出使用者的手勢，再將手勢對應到家電的控制信號。使用時，使用者先將WES控制器的紅外線信號發射器，對準目標家電上的紅外線信號接收器，再做對應於控制信號的手勢，以RF信號將控制信號傳至WES接收器，再控制電器控制器，完成控制流程。也因此，WES是一個一對多、直覺的家電控制系統。裝置的設計上，WES控制器用到了裝載ARM處理器的STM32F4開發版，將離線訓練的MLP權重以及手勢辨識的程式碼，移植到嵌入式系統上，而訊號間的傳遞，則利用Arduino家族的開發版協助。本研究的主要貢獻在提出一個有別以往的穿戴式手勢辨識為主的家電控制系統，以及建立基於戒指型的裝戴式裝置的手勢資料庫。

關鍵字

基於加速計的手勢辨識；穿戴式裝置； WES ；智慧家庭；家電控制； MLP ；嵌入式系統

並列摘要

Wearable Electronic Domestic Appliances Control System (WES) combines wearable device on index finger and forearm to construct an intuitive controlling schema. The system prototype consists of three parts: WES controller, WES receiver, and local controller. The WES controller uses infra-red ray signal to identify WES receiver on the target electronic domestic appliance, and then sends command determined by users’ gesture recognition result via 315 Mhz RF signal. The gesture recognition system is implemented by learning MLP weights offline using over 8,000 gesture data, and embedded prediction code on STM32F4 develop board in WES controller. The accuracy of the model is 91.25%. The main contribution of this study is providing an intuitive way to control smart home appliances and building up dataset for gesture recognition on wearable device on index finger.

並列關鍵字

accelerometer-based gesture recognition ； wearable device ； WES ； smart home ； electronic domestic appliances control ； MLP ； embedded system

參考文獻

[11] Sang-Heon Lee, Myoung-Kyu Sohn, Dong-Ju Kim, Byungmin Kim, Hyunduk Kim, "Smart TV interaction system using face and hand gesture recognition," Consumer Electronics (ICCE), 2013 IEEE International Conference on , vol., no., pp.173,174, 11-14 Jan. 2013

[1] Lei Zhongcheng, Hu Wenshan, Li Hongyi, Yang Zhen, "Web-based remote networked control for smart homes," Control Conference (CCC), 2013 32nd Chinese , vol., no., pp.6567,6571, 26-28 July 2013

[5] Junghak Kim, Seungchul Kim, Sangtaick Park, Jinwoo Hong, "Home appliances controlling through Smart TV set-top box with screen-mirroring remote controller," ICT Convergence (ICTC), 2013 International Conference on , vol., no., pp.1009,1012, 14-16 Oct. 2013

[9] rie, K., Wada, M., Umeda, K., "3D Measurement by Distributed Camera System for Constructing an Intelligent Room," Networked Sensing Systems, 2007. INSS '07. Fourth International Conference on , vol., no., pp.118,121, 6-8 June 2007

[15] Ducloux, J., Petrashin, P., Lancioni, W., Toledo, L., "Remote control with accelerometer-based hand gesture recognition for interaction in digital TV," Micro-Nanoelectronics, Technology and Applications (EAMTA), 2014 Argentine Conference on , vol., no., pp.29,34, 24-25 July 2014

國際替代計量

穿戴式手勢辨識裝置應用於智慧家庭之研究

全文下載

主題瀏覽