Human Activity Recognition with Multimodal Sensing of Wearable Sensors

Chun-Mei Ma ； Hui Zhao ； Ying Li ； Pan-Pan Wu ； Tao Zhang ； Bo-Jue Wang

《電腦學刊》 32卷6期 (2021/12) Pp. 24-37

https://doi.org/10.53106/199115992021123206003

摘要

Human activity sensed by wearable sensors has multi-granularity data characteristics. Although deep learning-based approaches have greatly improved the accuracy of recognition, most of them mainly focus on designing new models to obtain deeper features, ignoring the different effects of different deep features on the accuracy of recognition. We think that discriminative features learning would improve the recognition performance. In this paper, we propose an end-to-end model ABLSTM that consists of Attention model and BLSTM model to recognize human activities. Specifically, the BLSTM model is used to extract deep features of various activities. After that, the Attention model is used to obtain the discriminative features representation by reducing the irrelevant features and enhancing the positive correlation features to each activity. Therefore, compared with traditional deep learning-based approaches, such as CNN and RNN based etc., the features learned by ABLSTM are more discriminative, which can be in response to the changes of activities. By testing our model on two public benchmark datasets: UCI and Opportunity. The results show that our model can well recognize human activities with F1 scores as high as 99.0% and 92.7% respectively on the two datasets, which pushes the state-of-the-art in human activities recognition of mobile sensing.

關鍵字

human activity recognition ； multimodal sensory data ； discriminative features representation ； wearable sensors