Open Journal Systems

Human-computer Interaction System based on Visual Gesture Recognition

Wencheng Dong

Article ID: 29-33
Vol 2, Issue 1, , Article identifier:

VIEWS - 101 (Abstract) 61 (PDF)


Human-computer interaction system is the medium for communicating and transmitting information between people and computers. With the rapid development of computer technology, traditional human computer interaction technologies such as mouse and keyboard, have not met the needs of the development of the times. Instead, people need another human-computer interaction technology which is faster, more natural and comfortable. Gesture-based human-computer interaction is one of the most important technologies in human-computer interaction system. There are problems remained in traditional gesture recognition methods, such as low recognition accuracy and complicated recognition process. In view of the defects above, this paper proposes a gesture recognition algorithm based on deep learning. The algorithm detects joint features of the gesture quickly through gesture estimation and classifies joint feature maps by using convolution neural network, which overcomes the difficulties of segmenting gesture images in complex background and improves the accuracy of recognition results. The experimental results indicate that the method has high recognition accuracy for various gestures at different scales, which reaches 98%. Finally, a human-computer interaction system is designed based on the algorithm, and the application of gesture recognition in the human-computer interaction system is demonstrated.


Gesture analysis; Deep learning; Gesture prediction; Robots; Gesture recognition

Full Text:



Agah A. Human interactions with intelligent systems: Research taxonomy [J]. Computers and Electrical Engineering 2000; 27(1): 71-107.

Tadeusiewicz R. Speech in human system interaction [C]. Human System Interactions. IEEE 2010: 2-13.

Qi J, Xu K, Ding XL. Vision-based on hand gesture recognition for human-robot interaction: A review [J]. Robot 2017; 39(4): 565-584.

Panwar M. Hand gesture recognition based on shape parameters [C]. International Conference on Computing 2012: 317-319.

(101 Abstract Views, 61 PDF Downloads)


  • There are currently no refbacks.

Copyright (c) 2019 Wencheng Dong

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.