Eye Movement Recognition and Its Human-Computer Interaction Application Based on LSTM
CSTR:
Author:
Affiliation:

Clc Number:

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Eye-movement interaction has a broad application prospect in the field of human-computer interaction. Aiming at the problems of traditional eye-movement interaction sensors, such as universal intrusiveness, complex calibration process and high price, low resolution of common monocular camera sensors, etc., an eye movement recognition method based on front-facing camera video using directional gradient histogram (HOG) features + SVM + LSTM neural network, and a simple human-computer interaction application are proposed in this study. Firstly, the region of eyes are localized and tracked after face alignment. Secondly, the open-close and non-blinking state of the eyes is judged by the SVM model. Then, the position of eye center between adjacent frames is analyzed to roughly judge the eye movements, and the suspicious interframe difference video sequence of intentional eye position is obtained, which is the input of the LSTM network for prediction, and then trigger computer commands to complete the interaction. Through the self-made data sample set (about 10% of which are negative samples), the accuracy of dynamic blink recognition is better than 95%, and the accuracy of eye movement behavior prediction is 99.3%.

    Reference
    Related
    Cited by
Get Citation

黄君浩,贺辉.基于LSTM的眼动行为识别及人机交互应用.计算机系统应用,2020,29(3):206-212

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:September 03,2019
  • Revised:November 04,2019
  • Adopted:
  • Online: March 02,2020
  • Published: March 15,2020
Article QR Code
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063