Research on Virtual Simulation based on Eye Movement Tracking

Shaopeng Li ； Yuming Qi ； Qiangqiang Li ； Ming Zhang ； Pengbo Feng

《International Core Journal of Engineering》 8卷11期 (2022/11) Pp. 107-114

https://doi.org/10.6919/ICJE.202211_8(11).0013

摘要

In view of the current eye tracking technology has a direct, can replace traditional human-computer interaction operation sensitivity and natural features, this article to control science, cognitive science, computer science, behavioral science theory as the instruction, constructs the eye movement data model and eye movement behavior model, designed the eye movement interaction mechanism and real-time recognition algorithm of eye movement behavior, Virtual keyboard eye control system and unmanned platform eye control system are realized. Firstly, in order to reflect the temporal and spatial characteristics and variation trend of eye movement information, a spatio-temporal cube model based on eye movement data was constructed. Then, region-based eye-movement interaction mechanism was designed, and three eye-movement behavior models of fixation, eye potential and conscious blinking were constructed based on this, and real-time recognition algorithms were designed respectively for these three kinds of eye-movement behavior. Then, according to the principle of eye movement interaction, a human-computer interaction system design framework based on eye movement is proposed, and the interaction instructions are formally represented.

關鍵字

Eye Tracking ； Human-computer Interaction ； The Eye Control Systerm ； Interactive Mechanism

參考文獻

Nunneley C E, Fishman M, Sundheim K M. Leading synchronous virtual teaching sessions[J]. The Clinical Teacher, 2020, (in Chinese) (3) : 231-235.

Kangas J,Rantala J,Akkil D,et al.Vibrotactile Stimulation of the Head Enables Faster Gaze Gestures[J]. International Journal of Human-Computer Studies, 2016, 98: 62-71.

Zhao Ying, Liang Jinpeng, Yan Liqi, et al. Research on the Influence of Sign Setting on Tourists' Wayfinding Behavior: An experimental analysis based on eye tracking [J]. Tourism Tribune, 2020, 35(9): 63-73.

Xue Yaofeng, Zeng Zhitong. Study on eye movement model of learners with different cognitive styles for adaptive learning [J]. Modern Educational Techniques, 2020, (8) : 91-97.

Xue Yaofeng, Li Zhuowei. Research on quantitative model of cognitive load in online learning based on eye-tracking technology [J]. Modern Educational Technology, 2019, (7) : 59-65.