基於深度學習物件偵測網路之口罩佩帶辨認

MASK WEARING IDENTIFICATION BASED ON DEEP LEARNING OBJECT DETECTION NETWORKS

王曦(Xi Wang) ； 繆紹綱(Shaou-Gang Miaou) ； 林映丞(Ying-Cheng Lin)

《技術學刊》 37卷1期 (2022/03) Pp. 53-63

摘要

佩帶好口罩有助於減少經由呼吸道飛沫傳染的風險，確保個人與他人的健康。研發口罩佩帶辨認系統有助於落實防疫自動化，降低人力成本，提高檢測效率，並降低檢測人員的感染風險。本研究採用最先進的通用深度學習影像物件偵測網路（像是YOLOv5）來自動辨認口罩的佩帶狀態，包括good（有正確戴好口罩）、improper（露出鼻頭，但未露出嘴巴）以及bad（沒有戴上口罩）。本研究使用現有的口罩遮擋人臉的資料庫訓練神經網路，再以手機實際錄製開放空間中的影片為測試集，以評估訓練好的神經網路對口罩佩帶辨認的效能。實驗結果顯示平均正確率為99.6%，平均精確度為99.7%，平均召回率為99.7%且平均執行速度為每秒66.3個畫面，整體表現已達可有效輔助人工檢測的水準。

關鍵字

深度學習 ； YOLOv5 ； 臉部偵測 ； 口罩佩帶辨認

並列摘要

Wearing a mask can help reduce the risk of droplets from the respiratory tract and ensure the health of individuals and others. The research and development of the mask wearing identification system will help implement the automation of epidemic prevention, reduce labor costs, improve detection efficiency, and reduce the risk of infection for inspectors. This study uses the most advanced general-purpose deep learning image object detection network (such as YOLOv5) to automatically identify the wearing states of the mask, including good (the mask is properly worn), improper (the nose is exposed, but the mouth is not), and bad (not wearing a mask). This study uses the existing database of mask-concealed human faces to train the neural network, and then uses a mobile phone to actually record videos in the open space as the test set to evaluate the effectiveness of the trained neural network for mask wearing recognition. Experimental results show that the average accuracy is 99.6%, the average precision is 99.7%, the average recall is 99.7%, and the average execution speed is 66.3 frames per second. The overall performance has reached a level that can effectively assist manual inspection.

並列關鍵字

deep learning ； YOLOv5 ； face detection ； mask wearing identification

參考文獻

Verma, S., M. Dhanak, and J. Frankenfield. 2020. “Visualizing the Effectiveness of Face Masks in Obstructing Respiratory Jets.” Physics of Fluids 32 (6). doi: 10.1063/5.0016018

Wong, K. W., K. M. Lam, and W. C. Siu. 2001. “An Efficient Algorithm for Human Face Detection and Facial Feature Extraction under Different Conditions.” Pattern Recognition 34 (10): 1993-2004. doi: 10.1016/S0031-3203(00)00134-5

Jeng, S. H., H. Y. M. Liao, C. C. Han, M. Y. Chern, and Y. T. Liu. 1998. “Facial Feature Detection Using Geometrical Face Model: An Efficient Approach.” Pattern Recognition 31 (3): 273-282. doi: 10.1016/S0031-3203(97)00048-4

Nagrath, P., R. Jain, A. Madan, R. Arora, P. Kataria, and J. Hemanth. 2021. “SSDMNV2: A Real Time DNN-based Face Mask Detection System Using Single Shot Multibox Detector and MobileNetV2.” Sustainable Cities and Society 66: 102692. doi: 10.1016/j.scs.2020.102692

Florida Atlantic University. 2020. “Face Mask Construction, Materials Matter for Containing Coughing, Sneezing Droplets.” Florida Atlantic University. Accessed June 30. https://phys.org/news/2020-06-mask-materialsdroplets.html