The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume XL-5/W6
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XL-5/W6, 51–58, 2015
https://doi.org/10.5194/isprsarchives-XL-5-W6-51-2015
Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., XL-5/W6, 51–58, 2015
https://doi.org/10.5194/isprsarchives-XL-5-W6-51-2015

  18 May 2015

18 May 2015

HUMAN ACTION POSELETS ESTIMATION VIA COLOR G-SURF IN STILL IMAGES

M. Favorskaya, D. Novikov, and Y. Savitskaya M. Favorskaya et al.
  • Institute of Informatics and Telecommunications, Siberian State Aerospace University, 31 Krasnoyarsky Rabochy av., Krasnoyarsk, 660014 Russian Federation

Keywords: Human Action, Poselets, Gauge-SURF, Random Forest, Still Image

Abstract. Human activity is a persistent subject of interest in the last decade. On the one hand, video sequences provide a huge volume of motion information in order to recognize the human active actions. On the other hand, the spatial information about static human poses is valuable for human action recognition. Poselets were introduced as latent variables representing a configuration for mutual locations of body parts and allowing different views of description. In current research, some modifications of Speeded-Up Robust Features (SURF) invariant to affine geometrical transforms and illumination changes were tested. First, a grid of rectangles is imposed on object of interest in a still image. Second, sparse descriptor based on Gauge-SURF (G-SURF) invariant to color/lighting changes is constructed for each rectangle separately. A common Spatial POselet Descriptor (SPOD) aggregates the SPODs of rectangles with following random forest classification in order to receive fast classification results. The proposed approach was tested on samples from PASCAL Visual Object Classes (VOC) Dataset and Challenge 2010 providing accuracy 61-68% for all possible 3D poses locations and 82-86% for front poses locations regarding to nine action categories.