The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XLII-2/W12
https://doi.org/10.5194/isprs-archives-XLII-2-W12-179-2019
https://doi.org/10.5194/isprs-archives-XLII-2-W12-179-2019
09 May 2019
 | 09 May 2019

AUTOMATIC DETECTION AND RECOGNITION OF 3D MANUAL GESTURES FOR HUMAN-MACHINE INTERACTION

D. Ryumin, I. Kagirov, D. Ivanko, A. Axyonov, and A. A. Karpov

Keywords: Sign Language, Gestures, Face Detection, Computer Vision, Machine Learning, Neural Networks

Abstract. In this paper, we propose an approach to detect and recognize 3D one-handed gestures for human-machine interaction. The logical structure of the modules of the system for recording a gestural database is described. The logical structure of the database of 3D gestures is presented. Examples of frames showing gestures in the format of Full High Definition, in the map depth mode and in the infrared illustrated. Models of a deep convolutional network for detecting faces and hand shapes are described. The results of automatic detection of the area with the face and the shape of the hand are given. Identified the distinctive features of the gesture at a certain point in time. The process of recognizing 3D one-handed gestures is described. Due to its versatility, this method can be used in tasks of biometrics, computer vision, machine learning, automatic systems of face recognition, sign languages.